Gate apparatus, control method of gate apparatus, and storage medium

ABSTRACT

A gate apparatus includes: an exit gate door; a first biometrics information acquisition unit that acquires, from a user who moves toward the exit gate door in a closed state, first target biometrics information to be compared with registered biometrics information registered in advance; a second biometrics information acquisition unit that acquires second target biometrics information to be compared with the registered biometrics information from the use who stops in front of the exit gate door when there is no matching in a comparison between the first target biometrics information and the registered biometrics information or the comparison is unable to be performed; and a door control unit that opens the closed exit gate door in accordance with a result of a comparison between the first target biometrics information or the second target biometrics information and the registered biometrics information.

INCORPORATION BY REFERENCE

This application is based upon and claims the benefit of priority fromInternational Application No. PCT/JP2018/038218, filed on Oct. 12, 2018,the disclosure of which is incorporated herein in its entirety byreference.

TECHNICAL FIELD

The present invention relates to a gate apparatus, a control method ofthe gate apparatus, and a storage medium.

BACKGROUND ART

International Publication No. WO 2018/061812 discloses a gate apparatusapplied to a gate system that automatically performs a faceauthentication operation performed in an inspection of immigration. Thegate apparatus disclosed in International Publication No. WO 2018/061812has a face authentication device that compares a face image acquiredfrom a camera with a face image acquired from a passport reader.

SUMMARY

In the gate apparatus disclosed in International Publication No. WO2018/061812, however, since the face of a subject who placed a passporton a passport reader in front of the face authentication device iscaptured by a camera, it is difficult for the subject to pass throughthe gate apparatus in a short time.

In view of the problem described above, the example object of thepresent invention is to provide a gate apparatus, a control method ofthe gate apparatus, and a storage medium that can reduce the timerequired for a user to pass through a gate apparatus.

According to one example aspect of the present invention, provided is agate apparatus including: an exit gate door; a first biometricsinformation acquisition unit that acquires, from a user who moves towardthe exit gate door in a closed state, first target biometricsinformation to be compared with registered biometrics informationregistered in advance; a second biometrics information acquisition unitthat acquires second target biometrics information to be compared withthe registered biometrics information from the use who stops in front ofthe exit gate door when there is no matching in a comparison between thefirst target biometrics information and the registered biometricsinformation or the comparison is unable to be performed; and a doorcontrol unit that opens the exit gate door in the closed state inaccordance with a result of a comparison between the first targetbiometrics information or the second target biometrics information andthe registered biometrics information.

According to another example aspect of the present invention, providedis a gate apparatus including: an exit gate door; a first biometricsinformation acquisition unit that acquires, from a user who moves towardthe exit gate door in a closed state, first target biometricsinformation to be compared with registered biometrics informationregistered in advance; a second biometrics information acquisition unitthat acquires second target biometrics information to be compared withthe registered biometrics information from the use who stops in front ofthe exit gate door when a direction of a face of the user moving towardthe exit gate door in the closed state is not directed to the exit gatedoor or a wearing item is worn by the face of the user; and a doorcontrol unit that opens the exit gate door in the closed state inaccordance with a result of a comparison between the first targetbiometrics information or the second target biometrics information andthe registered biometrics information.

According to yet another example aspect of the present invention,provided is a gate apparatus including: an exit gate door; a biometricsinformation acquisition unit that acquires target biometrics informationto be compared with registered biometrics information registered inadvance from a user who moves toward the exit gate door in a closedstate or stops in front of the exit gate door; and a door control unitthat opens the exit gate door in the closed state in accordance with adetermination result for declaration information associated with theregistered biometrics information matching the target biometricsinformation.

According to yet another example aspect of the present invention,provided is a control method of a gate apparatus having an exit gatedoor, and the control method includes: acquiring, from a user who movestoward the exit gate door in a closed state, first target biometricsinformation to be compared with registered biometrics informationregistered in advance; acquiring second target biometrics information tobe compared with the registered biometrics information from the use whostops in front of the exit gate door when there is no matching in acomparison between the first target biometrics information and theregistered biometrics information or the comparison is unable to beperformed; and opening the exit gate door in the closed state inaccordance with a result of a comparison between the first targetbiometrics information or the second target biometrics information andthe registered biometrics information.

According to yet another example aspect of the present invention,provided is a non-transitory storage medium storing a program thatcauses a gate apparatus having an exit gate door to perform: acquiring,from a user who moves toward the exit gate door in a closed state, firsttarget biometrics information to be compared with registered biometricsinformation registered in advance; acquiring second target biometricsinformation to be compared with the registered biometrics informationfrom the use who stops in front of the exit gate door when there is nomatching in a comparison between the first target biometrics informationand the registered biometrics information or the comparison is unable tobe performed; and opening the exit gate door in the closed state inaccordance with a result of a comparison between the first targetbiometrics information or the second target biometrics information andthe registered biometrics information.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic diagram illustrating the entire configuration ofan information processing system according to one example embodiment ofthe present invention.

FIG. 2 is a schematic diagram illustrating a customs inspection site inwhich a kiosk terminal and an electronic gate are installed according toone example embodiment of the present invention.

FIG. 3 is a block diagram illustrating one example of a hardwareconfiguration of a mobile terminal according to one example embodimentof the present invention.

FIG. 4A is a schematic diagram illustrating the external appearance ofthe kiosk terminal according to one example embodiment of the presentinvention.

FIG. 4B is a schematic diagram illustrating the external appearance ofthe kiosk terminal according to one example embodiment of the presentinvention.

FIG. 5 is a block diagram illustrating one example of a hardwareconfiguration of the kiosk terminal according to one example embodimentof the present invention.

FIG. 6A is a schematic diagram illustrating a configuration when asingle kiosk terminal according to one example embodiment of the presentinvention is installed.

FIG. 6B is a schematic diagram illustrating a configuration when asingle kiosk terminal according to one example embodiment of the presentinvention is installed.

FIG. 7A is a schematic diagram illustrating a configuration when twokiosk terminals according to one example embodiment of the presentinvention are installed.

FIG. 7B is a schematic diagram illustrating a configuration when twokiosk terminals according to one example embodiment of the presentinvention are installed.

FIG. 8A is a schematic diagram illustrating a configuration when threekiosk terminals according to one example embodiment of the presentinvention are installed.

FIG. 8B is a schematic diagram illustrating a configuration when threekiosk terminals according to one example embodiment of the presentinvention are installed.

FIG. 9 is a schematic diagram illustrating prevention of peeping in thekiosk terminal according to one example embodiment of the presentinvention.

FIG. 10 is a schematic diagram illustrating a configuration when thekiosk terminals according to one example embodiment of the presentinvention are installed at different heights.

FIG. 11 is a schematic diagram illustrating the external appearance ofan entrance gate terminal and an exit gate terminal forming theelectronic gate according to one example embodiment of the presentinvention.

FIG. 12 is a block diagram illustrating one example of a hardwareconfiguration of the entrance gate terminal forming the electronic gateaccording to one example embodiment of the present invention.

FIG. 13 is a block diagram illustrating one example of a hardwareconfiguration of the exit gate terminal forming the electronic gateaccording to one example embodiment of the present invention.

FIG. 14 is a block diagram illustrating one example of a hardwareconfiguration of a management server according to one example embodimentof the present invention.

FIG. 15A is a schematic diagram illustrating one example of adeclaration information entry window on the mobile terminal according toone example embodiment of the present invention.

FIG. 15B is a schematic diagram illustrating one example of adeclaration code display window on the mobile terminal according to oneexample embodiment of the present invention.

FIG. 16 is a sequence diagram illustrating the operation of the kioskterminal and the management server in the information processing systemaccording to one example embodiment of the present invention.

FIG. 17 is a sequence diagram illustrating a language setting operationof the kiosk terminal in the information processing system according toone example embodiment of the present invention.

FIG. 18A is a schematic diagram illustrating one example of a receptionwindow on the kiosk terminal according to one example embodiment of thepresent invention.

FIG. 18B is a schematic diagram illustrating one example of adeclaration detail confirmation window on the kiosk terminal accordingto one example embodiment of the present invention.

FIG. 18C is a schematic diagram illustrating one example of a guidewindow on the kiosk terminal according to one example embodiment of thepresent invention.

FIG. 19 is a sequence diagram illustrating the operation of the entrancegate terminal, the exit gate terminal, and the management server in theinformation processing system according to one example embodiment of thepresent invention.

FIG. 20 is a schematic diagram illustrating one example of anotification window in the exit gate terminal according to one exampleembodiment of the present invention.

FIG. 21 is a block diagram illustrating a configuration of aninformation processing apparatus according to another example embodimentof the present invention.

FIG. 22 is a block diagram illustrating a configuration of aninformation processing apparatus according to another example embodimentof the present invention.

EXAMPLE EMBODIMENT One Example Embodiment

An information processing apparatus, a gate apparatus, an informationprocessing method, and a control method of the gate apparatus accordingto one example embodiment of the present invention will be described byusing FIG. 1 to FIG. 20.

First, the entire configuration of the information processing systemaccording to the present example embodiment will be described by usingFIG. 1 and FIG. 2. FIG. 1 is a schematic diagram illustrating the entireconfiguration of the information processing system according to thepresent example embodiment. FIG. 2 is a schematic diagram illustrating acustoms inspection site in which a kiosk terminal and an electronic gateaccording to the present example embodiment are installed.

As illustrated in FIG. 1, an information processing system 1 accordingto the present example embodiment includes a kiosk terminal 10, anelectronic gate 20, a management server 50, and a mobile terminal 60.The electronic gate 20 has an entrance gate terminal 30 and an exit gateterminal 40. The information processing system 1 is a system thataccepts declaration in custom procedures at immigration of the users U,such as passengers, crews, or the like who enter a country from foreigncountries in an airport, a seaport, or the like and controls theelectronic gate 20 through which a particular user U who has completeddeclaration passes, for example.

For example, when the information processing system 1 is introduced inan airport of Japan, the user U may be a passenger or a member of a crewwho arrived at the airport from a foreign country by an airplane, whichmay be a Japanese who returns to and enters Japan from a foreign countrywhere he/she has been, a foreigner who enters Japan from a foreigncountry, or the like. More specifically, customs declaration, which isdeclaration in a custom procedure accepted in the information processingsystem 1, may be declaration in baggage clearance, for example, which isdeclaration of the same requirement as in the declaration by CustomsForm C No. 5360, Export/Import Declaration for Consigned Articles(Accompanied Articles/Unaccompanied Articles) in a case of declarationin Japan.

The management server 50 is installed within a customs facility, forexample. The kiosk terminal 10 and the electronic gate 20 are installedin a customs inspection site C where customs inspection is performed inan airport, a seaport, or the like, for example.

As illustrated in FIG. 2, the kiosk terminal 10 is installed near theentrance of the customs inspection site C that the user U enters. Nearthe kiosk terminal 10, a digital signage terminal 70 is installed thatdisplays a moving image or a static image to guide how to carry out aprocedure with the kiosk terminal 10. Further, the electronic gate 20and a manned booth M are installed at the exit of the customs inspectionsite C. Near the entrance gate terminal 30 of the electronic gate 20, adigital signage terminal 80 is installed that displays and providesguidance of notes in passing through the electronic gate 20 by a movingimage or a static image. In the manned booth M, for example,face-to-face customs inspection such as reception of declaration in acustoms procedure, inspection of baggage, or the like is performed by acustoms officer S.

The mobile terminal 60 is a terminal held or carried and used by theuser U. In the mobile terminal 60, a customs declaration application forperforming custom declaration in the kiosk terminal 10 is installed. Theuser U may use a declaration code generated by the customs declarationapplication of the mobile terminal 60 to perform customs declaration inthe kiosk terminal 10, as described later.

The kiosk terminal 10, the entrance gate terminal 30, the exit gateterminal 40, and the management server 50 are connected to a network NW.The network NW is formed of Wide Area Network (WAN), Local Area Network(LAN), a mobile communication network, or the like. The kiosk terminal10 and the management server are able to communicate with each other viathe network NW. The entrance gate terminal 30 and the exit gate terminal40 are able to communicate with each other via the network NW or withoutvia the network NW. The exit gate terminal 40 and the management server50 are able to communicate with each other via the network NW. Themobile terminal 60 is able to communicate with a server such as themanagement server 50 or the like via the network NW.

Next, each component in the information processing system 1 according tothe present example embodiment will be further described by using FIG. 3to FIG. 14.

First, the configuration of the mobile terminal will be described byusing FIG. 3. FIG. 3 is a block diagram illustrating an example of thehardware configuration of the mobile terminal 60.

The mobile terminal 60 is a terminal held or carried and used by theuser U, which is a mobile information device such as a smartphone, atablet terminal, a mobile phone, or the like, for example. Asillustrated in FIG. 3, the mobile terminal 60 has a central processingunit (CPU) 602, a random access memory (RAM) 604, a storage device 606,an input device 608, a display 610, a mobile wireless communication unit612, and a short-range wireless communication unit 614. The CPU 602, theRAM 604, the storage device 606, the input device 608, the display 610,the mobile wireless communication unit 612, and the short-range wirelesscommunication unit 614 are connected to the bus line 616.

The CPU 602 functions as a control unit that operates by executing aprogram stored in the storage device 606 and controls the operation ofthe entire mobile terminal 60. Further, the CPU 602 executes anapplication program stored in the storage device 606 to perform variousprocesses as the mobile terminal 60. The RAM 604 provides a memory fieldnecessary for the operation of the CPU 602.

For example, a customs declaration application used for performingcustoms declaration on the kiosk terminal 10 is installed in the storagedevice 606. The CPU 602 can perform various processes by which the userU performs customs declaration by executing the customs declarationapplication.

More specifically, the CPU 602 can accept entry by the user U ofdeclaration information that is necessary for customs declaration, forexample. The declaration information is information of the same detailas requirements to be filled in a Declaration for accompaniedarticles/unaccompanied articles, for example. That is, the declarationinformation includes information necessary for customs declaration suchas a name of the user U, a current address or a stay address in acountry to enter, an occupation, a birthday, a passport number, a flightnumber, an origin, a date of entry, details to be declared in customsdeclaration, for example.

Further, the CPU 602 can generate declaration code, which is a code suchas a two-dimensional code including declaration information input by theuser U, and cause the display 610 to display the generated declarationcode, for example, as described later. The mobile terminal 60 canfunction as a medium to display a declaration code.

The declaration code is not particularly limited as long as it caninclude declaration information and may be, for example, atwo-dimensional code such as a QR code (registered trademark). Further,the declaration code may be one-dimensional code such as a barcode, forexample. The CPU 602 may generate a declaration code with a term ofvalidity that sets a term of validity. The CPU 602 can cause the display610 to display the set term of validity together with the declarationcode. The declaration code with the term of validity becomes invalidwhen date and time set as the term of validity has expired after thegeneration thereof. With a term of validity being set in a declarationcode, it is possible to urge the user U to perform customs declarationas soon as possible after the generation of the declaration code.

Note that, when the user U is accompanied by family that is a companion,each of the user U and the accompanying family may perform customsdeclaration by using each mobile terminal 60, or the user U may performcustoms declaration as a representative of the family. When the user Uperforms customs declaration as a representative of the family, the CPU602 can generate a declaration code for the accompanying family used bythe accompanying family on the kiosk terminal and display the generateddeclaration code on the display 610 in addition to the declaration codeused by the user U by himself/herself on the kiosk terminal 10. Theaccompanies family may use the declaration code for the accompanyingfamily displayed on the mobile terminal 60 of the user U and use thekiosk terminal 10 in the same manner as the user U. Further, theaccompanying family is guided to the electronic gate 20 or the mannedbooth M in the same manner as the user U after the use of the kioskterminal 10.

Further, the code display medium that displays a declaration code is notnecessarily required to be the mobile terminal 60 and may be othermedium. For example, the declaration code may be printed in a sheet as acode display medium.

Further, the customs declaration application supports multiple languagessuch as the Japanese language, the English language, the Chineselanguage, the Korean language, or the like, for example. Thereby, on thecustoms declaration application, display and entry are available with alanguage selected and set out of a plurality of languages in accordancewith the language setting of the mobile terminal 60, for example.Further, on the customs declaration application, display and entry maybe available with a language selected and set out of a plurality oflanguages in accordance with the setting in the application in additionto the language setting of the mobile terminal 60, for example. Thecustoms declaration application can be used in a use language that is alanguage set in such a way.

The CPU 602 can further include language information in the declarationcode, which is information indicating the use language in the customsdeclaration application. For example, the language information isinformation indicating the language set in accordance with the languagesetting of the mobile terminal 60 or, when a language is set as thesetting within the customs declaration application, informationregarding the set language.

The storage device 606 is formed of a storage medium such as anon-volatile memory, a hard disk drive, or the like and functions as astorage unit. The storage device 606 stores a program executed by theCPU 602, data referenced by the CPU 602 in execution of the program, orthe like. The storage device 606 stores a customs declarationapplication as an application program executed by the CPU 602.

The storage device 606 can store information such as declarationinformation input by the customs declaration application. Further, thestorage device 606 can store a declaration code generated by the customsdeclaration application.

The input device 608 is a touchscreen embedded in the display 610, forexample. The input device 608 functions as an input unit that acceptsentry from the user U. The user U may input various information or inputan instruction of execution of a process to the mobile terminal 60 viathe input device 608. For example, the user U may input declarationinformation or input an instruction of generating a declaration code viathe input device 608, which is a touchscreen, to the mobile terminal 60that executes the customs declaration application.

The display 610 functions as a display unit that displays variouswindows to the user U. For example, on the mobile terminal 60 thatexecutes the customs declaration application, the display 610 displays adeclaration information entry window that accepts entry of declarationinformation, a declaration code display window that displays adeclaration code, or the like as described later.

The mobile wireless communication unit 612 is connected to the networkNW via a mobile communication network under the control of the CPU 602.The communication scheme of the mobile wireless communication unit 612is not particularly limited and may be, for example, a third generationmobile communication scheme, a Long Term Evolution (LTE) scheme, afourth generation mobile communication scheme, or the like.

The short-range wireless communication unit 614 wirelessly communicateswith an access point, an external device, or the like under the controlof the CPU 602 and is connected to the network NW via an access point ina premise of an airport or the like, for example. Without being limitedin particular, the communication scheme of the short-range wirelesscommunication unit 614 may be, for example, a wireless LAN scheme suchas Wi-Fi (registered trademark), a Bluetooth (registered trademark)communication scheme, a Near Field Communication (NFC) scheme, aninfrared communication scheme, or the like.

In such a way, the mobile terminal 60 is configured.

Next, the configuration of the kiosk terminal 10 will be described byusing FIG. 4A to FIG. 10. FIG. 4A and FIG. 4B are schematic diagramsillustrating the external appearance of the kiosk terminal 10. FIG. 4Ais a perspective view illustrating the entire kiosk terminal 10installed on a pole 100, and FIG. 4B is an enlarged perspective view ofthe kiosk terminal 10 installed on the pole 100. FIG. 5 is a blockdiagram illustrating one example of the hardware configuration of thekiosk terminal 10. FIG. 6A and FIG. 6B are schematic diagramsillustrating the configuration when one kiosk terminal 10 is installed.FIG. 7A and FIG. 7B are schematic diagrams illustrating theconfiguration when two kiosk terminals 10 are installed. FIG. 8A andFIG. 8B are schematic diagrams illustrating the configuration when threekiosk terminals 10 are installed. FIG. 9 is a schematic diagramillustrating prevention of peeping in the kiosk terminal 10. FIG. 10 isa schematic diagram illustrating a configuration when the kioskterminals 10 are installed at different heights.

The kiosk terminal 10 is an information processing apparatus thataccepts customs declaration by a declaration code displayed on themobile terminal of the user U and guides the user U to the electronicgate 20 or the manned booth M in accordance with the detail of thecustoms declaration. As illustrated in FIG. 4A and FIG. 4B, the kioskterminal is attached and installed to the side of the pole 100 that is asupport member installed with the longitudinal direction beingperpendicular. Note that one or a plurality of kiosk terminals 10 may beinstalled to one pole 100 as described later.

Further, as illustrated in FIG. 5, the kiosk terminal 10 has a CPU 102,a RAM 104, a storage device 106, an input device 108, and a display 110.Furthermore, the kiosk terminal 10 has a passport reading device 112, acode reading device 114, a camera 116, a depth camera 118, acommunication unit 120, and a status lamp 122. The CPU 102, the RAM 104,the storage device 106, and input device 108, the display 110, thepassport reading device 112, the code reading device 114, the camera116, the depth camera 118, the communication unit 120, and the statuslamp 122 are connected to a bus line 124.

As illustrated in FIG. 4A and FIG. 4B, the kiosk terminal 10 has acasing 126 attached to the pole 100. The casing 126 has a first casingportion 126 a on which the display 110 and the camera 116 are providedand a second casing portion 126 b on which the passport reading device112 and the code reading device 114 are provided. Note that the CPU 102,the RAM 104, the storage device 106, and the communication unit 120 areaccommodated inside the casing 126.

The first casing portion 126 a has a display face on which the display110 is provided. The second casing portion 126 b has a reading face onwhich the passport reading device 112 and the code reading device 114are provided. The second casing portion 126 b is integrally coupled tothe lower part of the first casing portion 126 a such that the displayface and the reading face form an obtuse angle relative to each other.The first casing portion 126 a and the second casing portion 126 b areconfigured such that, when the kiosk terminal 10 is installed on thepole 100, the display face of the first casing portion 126 a faces theforward diagonally upward direction, which is opposite to the rearwarddirection on the pole 100 side, and the reading face of the secondcasing portion 126 b is substantially horizontal.

The kiosk terminal 10 is installed on the pole 100 so as to be locatedat a height by which the user U having a height above a predeterminedheight looks down at the display 110 and both the passport readingdevice 112 and the code reading device 114, for example.

The display 110 is provided on the display face of the first casingportion 126 a such that the screen thereof faces the forward diagonallyupward direction. The input device 108 as a touchscreen is embedded inthe display 110.

Further, the camera 116 is provided at the center of a part between thedisplay 110 and the second casing portion 126 b, which is a lower partof the display face of the first casing portion 126 a. The camera 116 isprovided between the display 110, which is a display unit provided onthe first casing portion 126 a, and the passport reading device 112 andthe code reading device 114, which are an information acquisition unitprovided on the second casing portion 126 b. Note that, while the singlecamera 116 is provided, two cameras 116 may be provided in the upperpart and the lower part interposing the display 110. In such a case, thecamera 116 on the lower side is provided at the center of a part betweenthe display 110 and the second casing portion 126 b, which is a lowerpart in the display face of the first casing portion 126 a, as describedabove, for example. On the other hand, the camera 116 on the upper sideis provided at the center of an upper side of the display 110 in anupper part of the display face of the first casing portion 126 a, forexample.

The camera 116 is provided such that the capturing direction faces theforward diagonally upward direction. The user U in front of the kioskterminal 10 will direct his/her eyes in the forward diagonally downwarddirection and look down at the display 110, the passport reading device112, or the code reading device 114 to operate the kiosk terminal 10.The camera 116 has a view angle so as to be able to capture the face ofthe user U looking down at the display 110, the passport reading device112, or the code reading device 114 to operate the kiosk terminal 10 asdiscussed above.

Further, the depth camera 118 is provided at the center of an upper partof the display face of the first casing portion 126 a. The depth camera118 is provided so as to be able to acquire three-dimensionalinformation of an object captured by the camera 116. Note that the depthcamera 118 may be provided to be arranged adjacent to one or two cameras116 provided as described above.

Further, plate-shape visors 128 are provided along the display 110 onthe both sides of the display face of the first casing portion 126 a soas to protrude from the display face, respectively. Each of the visors128 functions as a shielding unit that blocks a glance directed to thedisplay 110 from the side direction of the kiosk terminal 10, from thediagonally backward direction or from the diagonally forward directionand makes it difficult for a person other than the user U using thekiosk terminal 10 to peep the display 110.

Further, lighting members 130 that are lighting units for irradiatingthe face of the user U operating the kiosk terminal 10 are provided onthe both sides of the display face of the first casing portion 126 a,respectively. For example, each of the lighting members 130 may beformed of a light source such as a light source that emits light fromthe lower part to the upper part along the display 110 or a bar-shapelight source provided along the display 110. As a light source, althoughnot limited in particular, a light emitting diode (LED) or the like canbe used. With the lighting members 130 provided on both sides of thedisplay 110, sufficient brightness can be maintained when the face ofthe user U operating the kiosk terminal 10 is captured by the camera116. Note that the lighting members 130 may be always turned on duringthe operation of the kiosk terminal 10. Further, the lighting members130 are not necessarily required to be always turned on during theoperation of the kiosk terminal 10 and may be configured to be turned onwhen the face of the user U is captured by the camera 116. In such acase, the lighting members 130 can be configured to be turned on inresponse to the passport being read by the passport reading device 112or the declaration code being read by the code reading device 114, forexample. Further, the lighting members 130 may be configured to beturned on in response to the user U being detected by a human detectionsensor (not illustrated) provided on the kiosk terminal 10, for example.Further, the lighting members 130 turned on at such a predeterminedtiming may be configured to be turned off after the capturing of theface of the user U by the camera 116 has finished or after apredetermined time has elapsed, for example.

The passport reading device 112 is provided on the left side, and thecode reading device 114 is provided on the right side with respect tothe display 110 on the reading face of the second casing portion 126 b.In other kiosk terminals installed in an airport or the like, a readingdevice that reads a code such as a QR code is provided on the right sidewith respect to the terminal in general. Also in the kiosk terminal 10,with the code reading device 114 being provided on the right side withrespect to the display 110, the user U is able to smoothly hold adeclaration code displayed on the mobile terminal 60 over the codereading device 114 to cause the code reading device 114 to read thedeclaration code.

The passport reading device 112 is provided such that a reading unitthat reads a passport is directed upward, for example, and is configuredto have a slot into which the passport is inserted above the readingunit thereof. In such a case, the user U is able to cause the passportreading device 112 to read a passport by inserting the passport into theslot with the identity related page opened and the page facing down andholding it over the reading unit of the passport reading device 112. Ina system in which a passport is inserted into a slot, once a passport isinserted into a slot, the user U is not required to continue to pressthe passport in order to keep the page opened and is able to accuratelyposition the passport to the reading unit of the passport reading device112. This can realize smooth reading of a passport.

Note that the configuration of the passport reading device 112 is notlimited to the above configuration, and various configurations may beemployed. For example, the passport reading device 112 may be configuredsuch that the user U presses the passport on the reading unit with theidentity related page opened. In such a case, the user U can cause thepassport reading device 112 to read the passport by placing the passportfacing down with the identity related page opened and pressing andholding the passport over the reading unit of the passport readingdevice 112.

Further, the code reading device 114 is also provided with the readingunit that reads a declaration code facing upward, for example. In such acase, the user U can cause the code reading device 114 to read adeclaration code by holding the display 610 of the mobile terminal 60,on which a declaration code is displayed, over the reading unit of thecode reading device 114 with the display 610 facing down.

Note that the configuration of the code reading device 114 is also notlimited to the configuration described above, and various configurationsmay be employed. For example, the code reading device 114 may beconfigured such that the reading unit thereof reads a declaration codefrom the upper side. In such a case, the user U can cause the codereading device 114 to read a declaration code by holding the display 610of the mobile terminal 60, on which a declaration code is displayedunder the reading unit of the code reading device 114 with the display610 facing up.

The status lamp 122 is provided on the upper part of the pole 100 so asto be located above the first casing portion 126 a including the display110. The status lamp 122 is provided on the tip of an arm 132 attachedon the upper part of the pole 100 such that the status lamp 122 islocated corresponding to the upper part of the kiosk terminal 10 thatindicates a status. The arm 132 projects on the upper side of the kioskterminal 10 from the pole 100.

Further, a surveillance camera 134 that monitors the status of the kioskterminal 10 is provided on the arm 132. More specifically, thesurveillance camera 134 that functions as a monitoring unit captures andmonitors the view of the kiosk terminal 10 and the periphery thereof,the view of the user U who operates the kiosk terminal 10, or the like.The surveillance camera 134 is connected to the corresponding kioskterminal 10 or the network NW. The surveillance camera 134 can transmita video in which the view of the user U is captured to the managementserver 50 via the network NW via or without via the kiosk terminal 10.

The CPU 102 functions as a control unit that operates by executing aprogram stored in the storage device 106 and controls the operation ofthe entire kiosk terminal 10. Further, the CPU 102 executes anapplication program stored in the storage device 106 to perform variousprocesses as the kiosk terminal 10. The RAM 104 provides a memory fieldnecessary for the operation of the CPU 102.

More specifically, the CPU 102 functions as a comparison request unitthat requests the management server 50 to perform face recognition ofthe user U who uses the kiosk terminal 10 to perform customsdeclaration. The CPU 102 as the comparison request unit requests acomparison between a captured face image of the user U and a passportface image of the user U as face recognition of the user U. The capturedface image is a face image of the user U captured by the camera 116during the use of the kiosk terminal 10. A passport face image is a faceimage acquired from the passport of the user U by the passport readingdevice 112. To request comparison, the CPU 102 transmits a captured faceimage and a passport face image or a face feature amount extractedtherefrom to the management server 50 together with a comparisonrequest. Once the CPU 102 reads at least one of a passport and adeclaration code and acquires a captured face image of the user U and,on the other hand, reads the other of the passport and the declarationcode the CPU 102, the CPU 102 can request the management server 50 forface recognition of the user U. Note that the timing when the CPU 102acquires a captured face image and the timing when the CPU 102 requestsface recognition are not limited to the above, and various variationsare possible, respectively.

The CPU 102 can perform wearing item estimation in a captured face imageduring capturing by the camera 116. The CPU 102 can detect a wearingitem on a face, such as a mask, sunglasses, glasses, a hat, or the likein a captured face image by performing wearing item estimation. When awearing item on a face, which is a wearing item worn by the face of theuser U, is detected, the CPU 102 may warn the user U to put off thewearing item on the face which may prevent a face recognition. Forexample, the CPU 102 may perform warning by displaying display on thedisplay 110 that instructs the user U to put off the wearing item on theface or by outputting a voice from a speaker or the like that instructsthe user U to put off the wearing item on the face.

Further, the CPU 102 functions as a comparison information acquisitionunit that receives and acquires, from the management server 50,comparison information that is information indicating a result of theface recognition requested from the management server 50. Comparisoninformation indicates that a passport face image and a captured faceimage are matched and identity verification of the user U performingcustoms declaration on the kiosk terminal 10 succeeded as a result ofthe face recognition or that a passport face image and a captured faceimage are not matched and identity verification of the user U performingcustoms declaration on the kiosk terminal 10 failed. Note that a casewhere a passport face image and a captured face image are matchedincludes a case where a comparison score indicating the similaritybetween both face images exceeds a predetermined threshold and both theface images have a high similarity.

Note that the CPU 102 can function as a comparison unit that compares apassport face image with a captured face image to acquire comparisoninformation as face recognition of the user U instead of functioning asthe comparison request unit and the comparison information acquisitionunit. In a comparison between a passport face image and a captured faceimage, the CPU 102 can compare a face feature amount extracted from thepassport face image with a face feature amount extracted from thecaptured face image and thereby compare both the face images.

Further, the CPU 102 functions as a user information transmission unitthat transmits user information on the user U to the management server50. The user information on the user U includes identity relatedinformation, face information, and declaration information on the user Uassociated with each other.

Identity related information includes information on the individual userU, such as, the name, the birthday, or the like of the user U. Further,identity related information includes information on the passport of theuser U, such as the passport number of the user U, the term of validityof the passport, or the like. The identity related information isacquired from a passport of the user U by the passport reading device112.

Face information corresponds to a captured face image and a passportface image of the user U. Further, face information may not be acaptured face image itself and a passport face image itself and may beface feature amounts extracted from a captured face image and a passportface image, respectively. In such a case, the CPU 102 extracts facefeature amounts from a captured face image and a passport face image,respectively.

Declaration information includes information to be declared in customsdeclaration when the user U enters a country. The declarationinformation is information acquired from a declaration code displayed onthe mobile terminal 60 of the user U by using the code reading device114. As described above, declaration information includes informationnecessary for customs declaration such as the name of the user U, thecurrent address or the stay address in the country that the user Uenters, the occupation, the birthday, the passport number, the flightnumber, the origin, the date of entry, details to be declared in customsdeclaration, or the like, for example.

Note that user information on the user U transmitted to the managementserver 50 is registered to a user information database (DB) 506 a in themanagement server 50, as described later. A captured face image or apassport face image included in user information is registered in theuser information DB 506 a as a registered face image, which isregistered biometrics information registered in advance.

Further, the CPU 102 functions as a determination request unit thatrequests the management server 50 to determine the declaration detailincluded in declaration information on the user U who performs customsdeclaration by using the kiosk terminal 10. The CPU 102 as thedetermination request unit requests determination of the declarationdetail included in declaration information transmitted to the managementserver 50. The CPU 102 receives, from the management server 50,determination information that is information indicating a result ofdetermination of the declaration detail included in declarationinformation.

Further, the CPU 102 functions as a determination informationacquisition unit that receives and acquires, from the management server50, determination information that is information indicating a result ofdetermination of the declaration detail requested from the managementserver 50. Determination information indicates whether or not the user Uis taxable or whether or not there is a risk in the user U, as a resultof determination. A case where the user U is taxable is a case where thedeclaration detail includes declaration stating that the user U hasitems exceeding the duty-free allowance, a case where the declarationdetail includes declaration stating that the user U has commercial goodsor samples, or the like, for example. A case where there is a risk inthe user U is a case where the declaration detail includes declarationstating that the user U has an item that is prohibited or restricted tobring into that country, a case where the declaration detail includesdeclaration stating that the user U has an item requested from someoneelse to bring, or the like, for example.

Note that the CPU 102 can function as a determination unit thatdetermines the declaration detail included in declaration information ofthe user U instead of functioning as the determination request unit andthe determination information acquisition unit. In such a case, the CPU102 can determine the declaration detail included in declarationinformation in the same manner as the management server 50.

Further, the CPU 102 functions as the determination unit that determineswhether or not the electronic gate 20 is allowed to be used for the userU based on comparison information and determination information receivedfrom the management server 50. The CPU 102 as the determination unitdetermines that the user U is allowed to use the electronic gate 20 whenthe passport face image and the captured face image of the user U arematched, the user U is not taxable, and there is no risk in the user U.On the other hand, the CPU 102 determines that the user U is not allowedto use the electronic gate 20 when the passport face image and thecaptured face image of the user U are not matched, the user U istaxable, or there is a risk in the user U.

Further, the CPU 102 can transmit, to the management server 50, gateavailability information that is information indicating a determinationresult of the availability of the electronic gate 20. In such a case,gate availability information transmitted to the management server 50 isregistered to the user information DB 506 a in the management server 50in association with user information, as described later. When thepassport face image and the captured face image of the user U arematched, the user U is not taxable, and there is no risk in the user U,the gate availability information indicates that the user U is allowedto use the electronic gate 20.

Further, the CPU 102 functions as a display control unit that causes thedisplay 110 to display a window such as guide, notification, or the liketo the user U who performs customs declaration on the kiosk terminal 10.For example, the CPU 102 as the display control unit causes the display110 to display a guide window showing how to use the kiosk terminal 10.Further, the CPU 102 causes the display 110 to display a declarationdetail confirmation window on which the user U confirms and, ifnecessary, modifies the declaration detail included in declarationinformation acquired from the mobile terminal 60 of the user U.

Further, the CPU 102 functions as a processing unit that performs aprocess on the user U who has performed customs declaration on the kioskterminal 10 in accordance with a determination result of theavailability of the electronic gate 20. More specifically, the CPU 102causes the display 110 to display a guide window that guides the user Uto the electronic gate 20 or the manned booth M and guides the user U tothe electronic gate 20 or the manned booth M in accordance with adetermination result of the availability of the electronic gate 20.

Further, the CPU 102 functions as a language setting unit that sets ause language on the kiosk terminal 10 based on language information readfrom a declaration code displayed on the mobile terminal 60 of the userU who performs customs declaration on the kiosk terminal 10. Further,when a change entry to change a use language on the kiosk terminal 10 toanother language is input from the user U via the input device 108, theCPU 102 changes the use language in accordance with the change entry.Note that the use language on the kiosk terminal 10 is a language inwhich various information is displayed on the display 110 and input fromthe input device 108 is accepted, for example. The kiosk terminal 10supports multiple languages such as the Japanese language, the Englishlanguage, the Chinese language, the Korean language, or the like, forexample, as with the customs declaration application of the mobileterminal 60. Thereby, the kiosk terminal 10 can display and entry in ause language set from a plurality of languages.

The storage device 106 is formed of a storage medium such as anon-volatile memory, a hard disk drive, or the like and functions as astorage unit. The storage device 106 stores a program executed by theCPU 102, data referenced by the CPU 102 in execution of the program, orthe like.

The input device 108 is a touchscreen embedded in the display 110, forexample. The input device 108 functions as an input unit that acceptsentry of an instruction from the user U. The user U may enter variousinformation or enter an instruction of execution of a process to thekiosk terminal 10 via the input device 108.

The display 110 functions as a display unit that displays variouswindows to the user U who uses the kiosk terminal 10. For example, thedisplay 110 displays a guide window showing how to use the kioskterminal 10, a declaration detail confirmation window to the user U, aguide window to the user U, or the like. Further, the display 110 maydisplay comparison information indicating a result of comparison betweena captured face image and a passport face image and determinationinformation indicating a result of determination of the declarationdetail.

The display 110 may be installed so as to be vertically long, forexample. With the vertically long display 110, it is possible to realizeinstallation of the kiosk terminal 10 in a narrow space while realizingdisplay of the same amount of information as that of a horizontally longdisplay of the same size. Furthermore, with the vertically long display110, it is possible to prevent, by the body of the user U standing infront of the display 110, peeping of the display 110 from behind.

The passport reading device 112 functions as a reading unit that reads apassport of the user U and acquires information recorded in thepassport. The passport reading device 112 is formed of an image scanner,a contactless integrated circuit (IC) reader, an optical characterreader (OCR) device, or the like, for example. The passport readingdevice 112 reads a passport that is a medium held over the reading unitthereof and acquires information from the passport.

For example, the passport reading device 112 reads and acquires identityrelated information on the user U indicated on the sheet of the passportby using an OCR device. Further, for example, the passport readingdevice 112 reads and acquires a passport face image of the user Uindicated on the sheet of the passport by using an image scanner.Further, in the case of an IC passport, the passport reading device 112reads and acquires identity related information on the user U, apassport face image, or the like stored in the IC chip of the ICpassport by using a contactless IC reader. Note that biometricsinformation on the user U recorded and included in a passport is notlimited to a face image and may be other biometrics information such asan iris image. The passport reading device 112 may acquire biometricsinformation on the user U included in the passport.

The code reading device 114 functions as a reading unit that reads adeclaration code displayed on the mobile terminal 60 of the user U andacquires declaration information and language information included inthe declaration code. For example, the code reading device 114 is a codereader in accordance with the type of a declaration code to be read,such as a QR code reader, a barcode reader, or the like. The codereading device 114 reads a declaration code displayed on the mobileterminal 60 that is a code display medium held over the reading unitthereof and acquires information from the declaration code.

The camera 116 functions as a biometrics information acquisition unitthat acquires a face image of the user U as biometrics information onthe user U who performs customs declaration by using the kiosk terminal10. For example, the camera 116 is a capturing apparatus such as adigital camera that captures a moving image or a static image of theface of the user U in front of the kiosk terminal 10 and acquires acaptured face image that is a face image of the user U from the capturedmoving image or the captured static image. The camera 116 captures aface image of the user U who operates the passport reading device 112 toread a passport or operates the code reading device 114 to read adeclaration code in front of the kiosk terminal 10 and thereby acquiresa captured face image under the control of the CPU 102 as describedlater. In such a way, once at least one of a passport and a declarationcode is read, the camera 116 can capture the face of the user U andacquire a captured face image. Note that, instead of the camera 116, aunit that acquires, from the user U, the same type of biometricsinformation as the biometrics information acquired from a passport bythe passport reading device 112 may be provided as the biometricsinformation acquisition unit.

The CPU 102 can set the number of pixels between eyes in a captured faceimage captured by the camera 116 to a predetermined range. In such acase, out of the face images captured by the camera 116, the CPU 102 canexclude a face image in which the number of pixels between eyes is lessthan a predetermined number of pixels from the target captured faceimages, for example. Thereby, the camera 116 can reliably capture theuser U who operates the kiosk terminal 10 without capturing a distantperson behind the user U who operates the kiosk terminal 10.

Further, the CPU 102 can mask a predetermined range on both sides in thecapturable range of the camera 116, respectively. Thereby, the camera116 can reliably capture the user U who operates the kiosk terminal 10while preventing inclusion of a person around the user U who operatesthe kiosk terminal 10.

Note that the kiosk terminal 10 may be configured such that a capturedface image captured by the camera 116 is not displayed on the display110 or the like. In such a case, the user U is unaware that his/her faceis captured on the kiosk terminal 10. Thus, the user U can comfortablyuse the kiosk terminal 10 without a feeling of hesitation against beingcaptured or without a mental pressure due to being captured.

The depth camera 118 acquires three-dimensional information on an objectto be captured by the camera 116. The CPU 102 can determine, based onthe three-dimensional information acquired by the depth camera 118,whether a captured face image of the user U captured by the camera 116is an image acquired from an actual human or an image acquired from atwo-dimensional image such as a photograph. This can prevent a fraudsuch as impersonation.

The communication unit 120 is connected to the network NW and transmitsand receives data via the network NW. The communication unit 120communicates with the management server 50 or the like under the controlof the CPU 102.

The status lamp 122 functions as a status display unit that indicatesthe status of the kiosk terminal 10. More specifically, the status lamp122 can indicates status such as the progress status of customsdeclaration of the user U on the kiosk terminal 10, the presence orabsence of an anomaly of the kiosk terminal 10, the status ofavailability of the kiosk terminal 10, or the like, for example, as thestatus of the kiosk terminal 10 by using different lamp colors. Thestatus lamp 122 can be turned on in a lamp color in accordance with thestatus of the kiosk terminal 10 under the control of the CPU 102. Notethat a surveillance camera for detecting suspicious behavior may beprovided between the status lamp 122 and the pole 100. This surveillancecamera can be configured to start capturing once a passport is read bythe passport reading device 112 or a declaration code is read by thecode reading device 114, for example.

The status lamp 122 can be turned on in different lamp colors such aslighting in green, lighting in yellow, lighting in red, blinking ingreen, blinking in yellow, or blinking in red, for example, inaccordance with the status. In such a case, each lamp color indicatesthe following status, for example. That is, lighting in green indicatesa case where there is a matching in a face recognition and there is noproblem in custom information. Lighting in yellow indicates a case wherea face recognition failed. Lighting in red indicates a case where thereis a problem in custom information. Blinking in green indicates a casewhere customs declaration status is late. Blinking in yellow indicates acase where there is a problem in a system including the kiosk terminal10. Blinking in red indicates a case where an illegal passport isdetermined or a person included in a blacklist is determined by facerecognition. Note that these are mere examples, and the combination oflamp colors and status may be other combinations. As discussed above,the status lamp 122 can be turned on in a different manner based on atleast one of information read by the passport reading device 112 or thecode reading device 114, a result of face recognition, and the status ofprocedures, for example. Further, the lighting members 130 describedabove provided on the sides of the display 110 may also be turned on inthe same color as the status lamp 122. The lighting member 130 may beturned on in a different manner based on at least one of informationread by the passport reading device 112 or the code reading device 114,a result of face recognition, and the status of procedures, for example,in the same manner as the status lamp 122. In such a case, the lightingmembers 130 may be provided on the upper face or the upper end of thevisors 128, for example. While the screen content in the display 110 ishidden from the periphery by the visors 128, a person interested such asa staff who knows the relationship between the lamp color and the statussuch as an error can recognize the status of the kiosk terminal 10 inaccordance with the lighting status of the status lamp 122 or thelighting members 130. This enables a person interested to attendproperly, such as promptly attending to the situation where the statuslamp 122 or the lighting members 130 blinks in red, for example.

In such a way, the kiosk terminal 10 is configured.

With respect to the kiosk terminal 10 configured as described above, thesingle kiosk terminal 10 may be installed on one pole 100, a pluralityof kiosk terminals 10 may be installed on one pole 100. FIG. 6B is aperspective view illustrating the configuration when one kiosk terminal10 is installed, and FIG. 6A is a top view of FIG. 6B. FIG. 7B is aperspective view illustrating the configuration when two kiosk terminals10 are installed, and FIG. 7A is a top view of FIG. 7B. FIG. 8B is aperspective view illustrating the configuration when three kioskterminals 10 are installed, and FIG. 8A is a top view of FIG. 8B.

In a case of configuration in which one kiosk terminal 10 is installedon one pole 100, the kiosk terminal 10 is installed on the side of thepole 100 facing a predetermined direction as illustrated in FIG. 6A andFIG. 6B.

Further, with a plurality of kiosk terminals 10 being installed on onepole 100, a kiosk terminal group that is an information processingapparatus group may be configured.

In a case of the configuration in which two kiosk terminals 10 areinstalled on one pole 100, the two kiosk terminals 10 are installed onthe side of the pole 100 radially about the pole 100 with predeterminedangle intervals, as illustrated in FIG. 7A and FIG. 7B. The angleinterval between two adjacent kiosk terminals is 120 degrees, forexample. In such a way, the kiosk terminal group including the two kioskterminals 10 is configured.

In a case of the configuration in which three kiosk terminals 10 areinstalled on one pole 100, the three kiosk terminals 10 are installed onthe side of the pole 100 radially about the pole 100 with predeterminedangle intervals, as illustrated in FIG. 8A and FIG. 8B. The angleinterval between two adjacent kiosk terminals 10 of the three kioskterminals 10 is equally 120 degrees, respectively, for example. In sucha way, the kiosk terminal group including the three kiosk terminals 10is configured.

In such a way, when a plurality of kiosk terminals 10 are installed, alarger spacing between respective users U who use the adjacent kioskterminals can be secured when the kiosk terminals 10 are installedradially about the pole 100 than when the kiosk terminals 10 arearranged laterally in a line and installed. This can make it difficultto peep the display 110 of the kiosk terminal 10 from the user U infront of the adjacent kiosk terminal 10.

Note that, when a plurality of kiosk terminals 10 are radiallyinstalled, the angle interval between two adjacent kiosk terminals 10 isnot limited to 120 degrees described above and may be appropriately set.Further, the number of kiosk terminals 10 installed on one pole 100 isnot limited to the number described above and may be four or greater.

Furthermore, the visors 128 are provided along the display 110 on bothsides of the display 110 are provided to the kiosk terminal 10,respectively. In the kiosk terminal 10, the visors 128 also make itdifficult to peep the display 110.

FIG. 9 illustrates blocking of a glance by using the visors 128 in theconfiguration in which three kiosk terminals 10 are installed asillustrated in FIG. 8A and FIG. 8B. As illustrated FIG. 9, a line ofsight directed to the adjacent kiosk terminal 10 from the user U infront of the kiosk terminal 10 will be blocked by the visor 128 providedon the adjacent kiosk terminal 10, as illustrated by dashed-line arrowsin FIG. 9. In such a way, the visor 128 also makes it difficult to peepthe display 110.

Further, when a plurality of kiosk terminals 10 are installed on onepole 100, the plurality of kiosk terminals 10 may be installed atdifferent heights. For example, as illustrated in FIG. 10, in theconfiguration in which three kiosk terminals 10 are installed, one ofthe kiosk terminals 10 may be installed at a position lower than theother two kiosk terminals 10. In such a way, with a plurality of kioskterminals 10 being installed at different heights from each other, theusers U of wide range of heights are able to use the kiosk terminal 10.Further, the user U who uses a wheelchair is able to use the kioskterminal 10 installed at the position lower than the remaining kioskterminals 10 while using the wheelchair, for example.

Note that the scheme to attach and fix the kiosk terminal 10 to the pole100 is not particularly limited, and various schemes may be used. Forexample, the kiosk terminal 10 may be installed by being fixed to any ofattachment positions in a plurality of stages of different heightsprovided on the pole 100 by screwing. Further, the kiosk terminal 10 maybe installed on the pole 100 so as to be able to be slid vertically bythe user U by himself/herself who uses the kiosk terminal 10, a customsofficer who manages the kiosk terminal 10, or the like, for example. Insuch a case, the user U or the like may slide vertically the kioskterminal 10 installed on the pole 100 to adjust the height of the kioskterminal 10.

Further, cords or cables such as the power supply cord (notillustrated), the communication cable (not illustrated), or the likeconnected to the kiosk terminal 10 are accommodated inside the pole 100and hidden. Further, the residual portion of the cords or the cables maybe accommodated inside the casing 126 of the kiosk terminal 10.

Note that the kiosk terminal 10 may be installed on various supportmembers such as a support stage, a counter, or the like other than thepole 100 described above.

Next, the configuration of the electronic gate 20 will be described byusing FIG. 11 to FIG. 13. FIG. 11 is a schematic diagram illustratingthe external appearance of the entrance gate terminal 30 and the exitgate terminal 40 forming the electronic gate 20. FIG. 12 is a blockdiagram illustrating one example of the hardware configuration of theentrance gate terminal 30. FIG. 13 is a block diagram illustrating oneexample of the hardware configuration of the exit gate terminal 40.

The electronic gate 20 is a gate apparatus that permits or refuses thepassage of the user U guided to the electronic gate 20 by the kioskterminal 10 based on a result of face recognition at the electronic gate20 or the like. The user U who is permitted to pass through theelectronic gate 20 can exit the customs inspection site C. The user Uwho is not permitted to pass through the electronic gate 20 will besubjected to a separate procedure, such as being guided to the mannedbooth M by a customs officer and subjected to face-to-face customsinspection by the customs officer, for example.

As illustrated in FIG. 11, the entrance gate terminal 30 and the exitgate terminal 40 forming the electronic gate 20 are installed at theentrance and the exit, respectively, on a gate passage P through whichthe user U guided to the electronic gate 20 who is allowed to use theelectronic gate 20 has to pass. On the gate passage P, the user U whohas entered the gate passage P is restricted to exit a passage otherthan the exit gate terminal 40 by a partition plate, a wall, a fence, aninspection stage, or the like installed on both sides along the gatepassage P, for example.

First, the entrance gate terminal 30 will be described by using FIG. 11and FIG. 12. As illustrated in FIG. 11, the entrance gate terminal 30 isa gate apparatus installed at the entrance of the gate passage P throughwhich the user U who has been guided to the electronic gate 20 passes.As illustrated in FIG. 12, the entrance gate terminal 30 has a CPU 302,a RAM 304, a storage device 306, entrance gate doors 308, passagedetection sensors 310, a communication unit 312, and guide indicators314. The CPU 302, the RAM 304, the storage device 306, the entrance gatedoors 308, the passage detection sensors 310, the communication unit312, and the guide indicators 314 are connected to a bus line 316.

Further, as illustrated in FIG. 11, the entrance gate terminal 30 has apair of casings 318 installed facing each other and interposing theentrance of the gate passage P. The entrance gate doors 308 that canclose a space between the pair of casings 318 are provided to the pairof the casings 318. Further, a plurality of passage detection sensors310 are provided to the pair of casings 318 so as to be aligned in theinward direction to the gate passage P. Further, the guide indicators314 facing the front of the entrance gate terminal 30, namely, facingthe outside of the gate passage P are provided to the pair of casings318. The CPU 302, the RAM 304, the storage device 306, and thecommunication unit 312 may be accommodated in the casing 318 or may beaccommodated in a casing separate from the casing 318.

The CPU 302 functions as a control unit that operates by executing aprogram stored in the storage device 306 and controls the operation ofthe entire entrance gate terminal 30. Further, the CPU 302 executes anapplication program stored in the storage device 306 to perform variousprocesses as the entrance gate terminal 30. The RAM 304 provides amemory field necessary for the operation of the CPU 302.

More specifically, the CPU 302 functions as a determination unit thatdetermines, based on output signals from the plurality of the passagedetection sensors 310 and the output order thereof, whether or not theuser U has passed through the entrance gate terminal 30 and entered thegate passage P.

Further, the CPU 302 functions as a door control unit that controls anopening operation and a closing operation of the entrance gate doors308. When no user U has entered the gate passage P, the CPU 302maintains the entrance gate doors 308 in an opened state. Further, oncedetermining that the user U has passed through the entrance gateterminal 30 and entered the gate passage P based on the output signalsfrom the passage detection sensors 310, the CPU 302 closes the entrancegate doors 308. Further, the CPU 302 maintains the entrance gate doors308 in the opened state until it is determined that the user U who hasentered the gate passage P has passed through the exit gate terminal 40and exited the gate passage P. Further, the CPU 302 determines that theuser U has exited the gate passage P in accordance with exit passageinformation transmitted from the exit gate terminal 40. In response todetermining that the user U has exited the gate passage P, the CPU 302opens the entrance gate doors 308.

Further, in response to determining that the user U has passed throughthe entrance gate terminal 30 and entered the gate passage P asdescribed above, the CPU 302 transmits, to the exit gate terminal 40,entrance passage information indicating that the user U has passedthrough the entrance gate terminal 30 and entered the gate passage P.

Further, the CPU 302 functions as a display control unit that controlsan indication on the guide indicators 314 in accordance with theopen/close state of the entrance gate doors 308. When the entrance gatedoors 308 are in an opened state, the CPU 302 causes the guideindicators 314 to display an indication indicating that entry to thegate passage P is permitted. Further, when the entrance gate doors 308are in a closed state, the CPU 302 causes the guide indicators 314 todisplay an indication indicating that entry to the gate passage P isprohibited.

The storage device 306 is formed of a storage medium such as anon-volatile memory, a hard disk drive, or the like and functions as astorage unit. The storage device 306 stores a program executed by theCPU 302, data referenced by the CPU 302 in execution of the program, orthe like.

The entrance gate doors 308 are closure doors that perform an openingoperation and a closing operation under the control of the CPU 302 andtransition between an opened state to permit passage of the user U and aclosed state to block passage of the user U. The opening and closingscheme of the entrance gate doors 308 is not particularly limited andmay be, for example, a flapper type, a slide type, a revolving type, orthe like.

In response to detecting passage of the user U, each of the passagedetection sensors 310 outputs an output signal indicating the passage ofthe user U. The CPU 302 can determine whether or not the user U haspassed through the entrance gate terminal 30 and entered the gatepassage P based on the output signals from the plurality of passagedetection sensors 310, which are provided on the pair of casings 318 soas to be aligned in the inward direction to the gate passage P, and theoutput order of the output signals. The passage detection sensor 310 isnot particularly limited and may be, for example, a transmission typephotoelectric sensor, a reflection type photoelectric sensor, or thelike. The transmission type photoelectric sensor has an emission unitthat emits a light such as an infrared ray and a light receiving unitthat receives the light emitted by the emission unit and outputs anoutput signal indicating passage of an object based on a change of thelight received by the light receiving unit.

The communication unit 312 is connected to the network NW and transmitsand receives data via the network NW. The communication unit 312communicates with the exit gate terminal 40 or the like under thecontrol of the CPU 302. Note that the communication unit 312 may beconnected to the exit gate terminal 40 so as to be able to communicatewith the exit gate terminal 40 without via the network NW.

The guide indictors 314 display an indication indicating whether topermit or refuse entry to the gate passage P under the control of theCPU 302. When the entrance gate doors 308 are in an opened state, theguide indicators 314 display an indication indicating that entry to thegate passage P is permitted. Further, when the entrance gate doors 308are in a closed state, the guide indicators 314 display an indicationindicating that entry to the gate passage P is prohibited. The guideindicators 314 can display an indication indicating whether to permit orrefuse entry to the gate passage P by using a color indication, a symbolindication, a text indication, or the like, for example.

In such a way, the entrance gate terminal 30 is configured.

Next, the configuration of the exit gate terminal 40 will be describedby using FIG. 11 and FIG. 13. As illustrated in FIG. 11, the exit gateterminal 40 is a gate apparatus installed at the exit of the gatepassage P that is a passage through which the user U who has been guidedto the electronic gate 20 passes. Further, as illustrated in FIG. 13,the exit gate terminal 40 has a CPU 402, a RAM 404, a storage device406, and a display 408. Further, the exit gate terminal 40 has a firstcamera 410, a second camera 412, exit gate doors 414, passage detectionsensors 416, a communication unit 418, and guide indicators 420. The CPU402, the RAM 404, the storage device 406, the display 408, the firstcamera 410, the second camera 412, the exit gate doors 414, the passagedetection sensors 416, the communication unit 418, and the guideindicators 420 are connected to a bus line 422.

Further, as illustrated in FIG. 11, the exit gate terminal 40 has a pairof casings 424 installed facing each other and interposing the exit ofthe gate passage P. The exit gate doors 414 that can close a spacebetween the pair of casings 424 are provided to the pair of the casings424. Further, a plurality of passage detection sensors 416 are providedto the pair of casings 424 so as to be aligned in the outward directionfrom the gate passage P. Further, the guide indicators 420 facing thefront of the exit gate terminal 40, namely, facing the inside of thegate passage P are provided to the pair of casings 424. The CPU 402, theRAM 404, the storage device 406, and the communication unit 418 may beaccommodated in the casing 424 or may be accommodated in a casingseparate from the casing 424.

Further, the display 408 is installed on one of the pair of casings 424.The display 408 is installed such that the screen thereof faces thecenter of the gate passage P in front of the exit gate terminal 40, forexample. The first camera 410 and the second camera 412 are provided onthe lower part and the upper part on the screen side on the display 408,respectively. Note that the installation position of the display 408 isnot particularly limited and may be a position where the user U on thegate passage P is able to look at the display 408.

The first camera 410 is a long-range camera that has a capturable rangein at least the inside of the gate passage P between the entrance gateterminal 30 and the exit gate terminal 40 and can capture a more distantplace than the second camera 412. The second camera 412 is a short-rangecamera that has a capturable range in at least a front area of the exitgate terminal 40. Note that the positions where the first camera 410 andthe second camera 412 are provided are not particularly limited and maybe any position that can realize respective capturable ranges.

The first camera 410 captures the user U who moves on the gate passage Pfrom the entrance gate terminal 30 to the exit gate terminal 40 andacquires the face image as a first target face image. The second camera412 captures the user U who moves on the gate passage P, reaches theexit gate terminal 40, and is located in front of the exit gate doors414 to acquire the face image as a second target face image, ifnecessary. Capturing of the user U by the first camera 410 is performedwithout causing the user U to be aware thereof. On the other hand,capturing of the user U by the second camera 412 is performed on theuser U who is notified by the display on the display 408 or the likethat capturing is performed, for example. The exit gate terminal 40 canperform non-positive authentication that performs identity verificationby face recognition using the first target face image captured by thefirst camera 410 without causing the user U to be aware thereof.Further, when non-positive authentication fails, the exit gate terminal40 can perform positive authentication that performs identityverification by face recognition using the second target face imagecaptured by the second camera 412 with the user U being aware thereof.

The CPU 402 functions as a control unit that operates by executing aprogram stored in the storage device 406 and controls the operation ofthe entire exit gate terminal 40. Further, the CPU 402 executes anapplication program stored in the storage device 406 to perform variousprocesses as the exit gate terminal 40. The RAM 404 provides a memoryfield necessary for the operation of the CPU 402.

More specifically, the CPU 402 functions as a comparison request unitthat requests the management server 50 for face recognition of the userU who has passed through the entrance gate terminal 30 and entered thegate passage P.

The CPU 402 as the comparison request unit requests the managementserver 50 to compare, at 1:N, the first target face image, which is aface image of the user U captured by the first camera 410, with aplurality of registered face images registered in the user informationDB 506 a of the management server 50. Thus, the CPU 402 transmits a facefeature amount extracted from the first target face image or the firsttarget face image itself to the management server 50 together with acomparison request.

Note that the CPU 402 functions as a quality determination unit thatcalculates a quality value indicating the quality of the first targetface image and determines whether or not the calculated quality value isgreater than or equal to a predetermined threshold. The quality valuemay be set to be a larger value for a higher quality of the first targetface image. The CPU 402 as the comparison request unit can request themanagement server 50 to compare the high quality first target face imagewhose quality value is greater than or equal to the predeterminedthreshold with registered face images. Note that the quality value maybe set to be a smaller value for a higher quality of the first targetface image. In such a case, the CPU 402 as the quality determinationunit can determine whether or not the calculated quality value is lessthan or equal to a predetermined threshold. Further, in such a case, theCPU 402 as the comparison request unit can request the management server50 to compare the high quality first target face image whose qualityvalue is less than or equal to the predetermined threshold withregistered face images. In such a way, the CPU 402 can determine thequality of the first target face image and request comparison of thehigh quality first target face image above a predetermined quality withregistered face images.

The first target face image is captured by the first camera 410 withoutcausing the user U to be aware. Thus, the first target face image whosequality value is above a predetermined level may not be obtained, orface recognition using the first target face image may be unmatched dueto a wearing item on the face, which is worn by the face of the user U,such as a mask, sunglasses, glasses, a hat, or the like. In such cases,the CPU 402 as the comparison request unit requests the managementserver 50 to compare, at 1:N, the second target face image, which is aface image of the user U captured by the second camera 412, with aplurality of registered face images registered by the user informationDB 506 a. Thus, the CPU 402 transmits a face feature amount extractedfrom the second target face image or the second target face image itselfto the management server 50 together with a comparison request.

The CPU 402 functions as a warning unit that warns the user U inaccordance with a state of the face of the user U during capturingperformed by the first camera 410. More specifically, the CPU 402 canperform warning as described below, for example.

First, the CPU 402 can perform line-of-sight detection in the firsttarget face image during capturing performed by the first camera 410.The CPU 402 can perform warning in accordance with the status of theline of sight of the user U detected from the first target face image byline-of-sight detection. That is, when determining that the user U looksdown or looks away as a result of line-of-sight detection, the CPU 402can warn the user U to face forward, which is the exit gate terminal 40side. For example, the CPU 402 can perform warning by displaying thedisplay on the display 408 that instructs the user U to change the facedirection to face forward or sounding a voice from a speaker or the likethat instructs the user U to change the face direction to face forward.In such a case, the warning display on the display 408 may be performedbefore face recognition is performed in order to prevent an unnecessaryfailure of face recognition.

Further, the CPU 402 can perform wearing item estimation in the capturedfirst target face image during capturing performed by the first camera410. The CPU 402 can detect a wearing item on the face, such as a mask,sunglasses, glasses, a hat, or the like in the first target face imageby the wearing item estimation. When a wearing item on the face isdetected, the CPU 402 can warn the user U to put off the wearing item onthe face that may prevent face recognition. For example, the CPU 402 canperform warning by displaying the display on the display 408 thatinstructs the user U to put off the wearing item on the face or soundinga voice from a speaker or the like that instructs the user U to put offthe wearing item on the face. In such a case, the warning display on thedisplay 408 may be performed before face recognition is performed inorder to prevent an unnecessary failure of face recognition.

Further, the CPU 402 functions as a comparison information acquisitionunit that acquires, from the management server 50, comparisoninformation indicating a result of face recognition of the first targetface image or the second target face image requested from the managementserver 50. The comparison information indicates that a registered faceimage matching the first target face image or the second target faceimage was found and identity verification of the user U succeeded or noregistered face image matching the first target face image or the secondtarget face image was found and identity verification of the user Ufailed as a result of comparison. Note that a case where the firsttarget face image or the second target face image and a registered faceimage are matched includes a case where a comparison score indicatingthe similarity between both face images exceeds a predeterminedthreshold and both the face images exhibit a high similarity.

Note that, instead of functioning as the comparison request unit and thecomparison information acquisition unit, the CPU 402 may be configuredto function as a comparison unit that compares, at 1:N, the first targetface image or the second target face image with registered face imagesin the user information DB 506 a and outputs comparison information. Insuch a case, the CPU 402 can perform comparison of a face image byreferencing the user information DB 506 a of the management server 50 orby referencing the user information DB stored in the storage device 406in synchronization with the user information DB 506 a.

Further, the CPU 402 can function as an information acquisition unitthat, when identity verification of the user U by face recognition issuccessful, acquires gate availability information associated with theuser information on the user U from the management server 50. The gateavailability information is information that indicates a determinationresult of the availability of the electronic gate 20 for the user U, asdescribed above.

Further, the CPU 402 functions as a determination unit that determineswhether or not the user U inside the gate passage P is allowed to passthrough the electronic gate 20 based on a comparison result of facerecognition of the first target face image or the second target faceimage and the determination result of the availability of the electronicgate 20. The CPU 402 as the determination unit determines that passageof the electronic gate 20 is allowed when there is a matching in facerecognition of the first target face image or the second target faceimage and identity verification of the user U is successful and when theuser U is allowed to use the electronic gate 20. A case where theidentity verification is successful is a case where the first targetface image or the second target face image and a registered face image,which is a captured face image or a passport face image acquired by thekiosk terminal 10, are matched. A case where the user U is allowed touse the electronic gate 20 is a case where there is gate availabilityinformation that is associated with user information including thematching registered face image and indicates that the user U is allowedto use the electronic gate 20.

Further, the CPU 402 functions as a door control unit that controls anopening operation and a closing operation of the exit gate doors 414. Inresponse to determining that the user U is allowed to pass through theelectronic gate 20, the CPU 402 opens the exit gate doors 414 whosenormal state is a closed state. Further, in response to determining thatthe user U has passed through the exit gate terminal 40 and exited thegate passage P based on the output signals from the passage detectionsensors 416, the CPU 402 closes the exit gate doors 414.

Further, the CPU 402 functions as a determination unit that determines,based on the output signals from the plurality of passage detectionsensors 416 and the output order of the output signals, whether or notthe user U has passed through the exit gate terminal 40 and exited thegate passage P.

Further, in response to determining that the user U has passed throughthe exit gate terminal 40 and exited the gate passage P as describedabove, the CPU 402 transmits, to the entrance gate terminal 30, exitpassage information indicating that the user U has passed through theexit gate terminal 40 and exited the gate passage P.

Further, the CPU 402 functions as a display control unit that controlsthe display on the display 408. The CPU 402 can cause the display 408 todisplay various notification to the user U inside the gate passage P.For example, the CPU 402 can cause the display 408 to display warningthat instructs the user U inside the gate passage P to put off a wearingitem on the face, such as a mask, sunglasses, glasses, a hat, or thelike, which may prevent face recognition. Further, for example, the CPU402 can cause the display 408 to display a notification indicating thatthe second camera 412 captures a face image, if necessary, to the user Uwho stops in front of the exit gate doors 414. When there is no matchingin a comparison between the first target face image and the registeredface image or when the comparison is unable to be performed, the CPU 402can cause the display 408 to perform display to instruct the user U tostop in front of the exit gate doors 414. In such a case, the CPU 402may further cause the display 408 to perform display to instruct theuser U to stop in front of the exit gate doors 414 and look at thedisplay 408. This can guide the user U so that the second camera 412 isable to capture a face image of the user U.

Further, the CPU 402 functions as a display control unit that controlsan indication on the guide indicators 420 in accordance with theopen/close state of the exit gate doors 414. When the exit gate doors414 are in an opened state, the CPU 402 causes the guide indicators 420to display an indication indicating that exit from the gate passage P ispermitted. Further, when the exit gate doors 414 are in a closed state,the CPU 402 causes the guide indicators 420 to display an indicationindicating that exit from the gate passage P is prohibited.

The storage device 406 is formed of a storage medium such as anon-volatile memory, a hard disk drive, or the like and functions as astorage unit. The storage device 406 stores a program executed by theCPU 402, data referenced by the CPU 402 in execution of the program, orthe like.

The display 408 functions as a display unit that displays variouswindows to the user U inside the gate passage P. For example, thedisplay 408 displays warning of an instruction to put off a wearing itemon the face, such as a mask, sunglasses, glasses, a hat, or the like,which may prevent face recognition. For example, the display 408displays a notification indicating that the second camera 412 capturesthe face, if necessary. Specifically, when a comparison is unable to beperformed with the first target face image captured by the first camera410, the display 408 displays display that instructs the user to stop infront of the display 408 and look at the direction of the second camera412 so that positive authentication is enabled. For example, the display408 may display such display that instructs the user to stop in front ofthe display 408 and look at the second camera 412 for faceauthentication or the like. Further, the display 408 can display acomparison result of positive authentication with the second target faceimage, which is a face image of the static user U, as a result ofnon-positive authentication with the first target face image, which is aface image of the moving user U.

The first camera 410 functions as a biometrics information acquisitionunit that captures the user U who enters the gate passage P and movestoward the exit gate terminal 40 on the gate passage P and acquires thefirst target face image, which is a face image of the user U, asbiometrics information on the user U. The first target face imagecaptured by the first camera 410 is a face image of the moving user U.For example, the first camera 410 is an image capture device such as adigital camera that captures a moving image or a static image of theuser U moving on the gate passage P and acquires the first target faceimage of the user U from the captured moving image or static image. Asdescribed above, the first camera 410 is a long-range camera that has acapturable range in at least the inside of the gate passage P betweenthe entrance gate terminal 30 and the exit gate terminal 40 and cancapture a more distant place than the second camera 412. The firstcamera 410 captures the user U without causing the user U to be aware ofbeing captured. Note that, instead of the first camera 410, a unit thatacquires, from the user U, the same type of biometrics information asthe registered biometrics information registered in the user informationDB 506 a of the management server 50 may be provided as the biometricsinformation acquisition unit.

The second camera 412 functions as a biometrics information acquisitionunit, if necessary, that captures the user U who moves on the gatepassage P and reaches and stops at the exit gate doors 414 of the exitgate terminal 40 and acquires the second target face image, which is aface image of the user U, as biometrics information on the user U. Thesecond target face image captured by the second camera 412 is a faceimage of the static user U. For example, the second camera 412 is acapturing apparatus such as a digital camera that captures a movingimage or a static image of the user U in front of the exit gate doors414 and captures the second target face image of the user U from thecaptured moving image or static image. As described above, the secondcamera 412 is a short-range camera that has a capturable range in atleast a front area of the exit gate terminal 40. The second camera 412captures the user U who has received a notification of capturing by wayof display on the display 408, voice guidance, or the like, for example.The second camera 412 acquires the second target face image to becompared with a registered face image from the user U who stops in frontof the exit gate doors 414 in a predetermined case. The predeterminedcase as used herein is a case where there is no matching in a comparisonbetween the first target face image and the registered face image or thecomparison is unable to be performed, as described later. Specifically,the predetermined case is a case where the face of the user U who movestoward the closed exit gate doors 414 is not directed to the exit gatedoors 414, a case where a wearing item is worn by the face of the userU, or the like. Note that, instead of the second camera 412, a unit thatacquires, from the user U, the same type of biometrics information asthe registered biometrics information registered in the user informationDB 506 a of the management server 50 may be provided as the biometricsinformation acquisition unit.

The exit gate doors 414 are closure doors that performs an openingoperation and a closing operation under the control of the CPU 402 andtransitions between a closed state to block passage of the user U and anopened state to permit passage of the user U. The opening and closingscheme of the exit gate doors 414 is not particularly limited and maybe, for example, a flapper type, a slide type, a revolving type, or thelike.

In response to detecting passage of the user U, each of the passagedetection sensors 416 outputs an output signal indicating the passage ofthe user U. The CPU 402 can determine whether or not the user U haspassed through the exit gate terminal 40 and exited the gate passage Pbased on the output signals from the plurality of passage detectionsensors 416 provided on the pair of casings 424 so as to be aligned inthe outward direction from the gate passage P and the output order ofthe output signals. The passage detection sensor 416 is not particularlylimited and may be, for example, a transmission type photoelectricsensor, a reflection type photoelectric sensor, or the like as with thepassage detection sensor 310 of the entrance gate terminal 30.

The communication unit 418 is connected to the network NW and transmitsand receives data via the network NW. The communication unit 418communicates with the management server 50, the entrance gate terminal30, or the like under the control of the CPU 402. Note that thecommunication unit 418 may be connected to the entrance gate terminal 30so as to be able to communicate with the entrance gate terminal 30without via the network NW.

The guide indicators 420 display an indication indicating whether topermit or refuse exit from the gate passage P under the control of theCPU 402. When the exit gate doors 414 are in a closed state, the guideindicators 420 display an indication indicating that exit from the gatepassage P is prohibited. Further, when the exit gate doors 414 are in anopened state, the guide indicators 420 display an indication indicatingthat exit from the gate passage P is permitted. The guide indicators 420can display an indication indicating whether to permit or refuse exitfrom the gate passage P by using a color indication, a symbolindication, a text indication, or the like, for example.

In such a way, the exit gate terminal 40 is configured.

Next, the configuration of the management server 50 will be described byusing FIG. 14. FIG. 14 is a block diagram illustrating one example ofthe hardware configuration of the management server 50.

The management server 50 is an information processing apparatus thatmanages the information processing system 1 and performs comparisonbetween a first target face image or a second target face image and aplurality of registered face images in the user information DB 506 a,determination of the declaration detail included in declarationinformation, or the like. Note that the function of the managementserver 50 may be implemented by a single server or may be implemented bya plurality of servers.

As illustrated in FIG. 14, the management server 50 has a CPU 502, a RAM504, a storage device 506, and a communication unit 508. The CPU 502,the RAM 504, the storage device 506, and the communication unit 508 areconnected to a bus line 510.

The CPU 502 functions as a control unit that operates by executing aprogram stored in the storage device 506 and controls the operation ofthe entire management server 50. Further, the CPU 502 executes anapplication program stored in the storage device 506 to perform variousprocesses as the management server 50. The RAM 504 provides a memoryfield necessary for the operation of the CPU 502.

More specifically, the CPU 502 functions as a comparison unit that, whena comparison request that requests face recognition of the user U isreceived from the kiosk terminal 10, performs face recognition of theuser U. The CPU 502 as a comparison unit compares, at 1:1, a capturedface image included in the user information with a passport face image.The CPU 502 can compare both face images by referencing a face featureamount extracted from a captured face image with a face feature amountextracted from a passport face image in the comparison between thecaptured face image and the passport face image.

Further, the CPU 502 functions as a transmission unit that transmitscomparison information indicating a result of face recognition of theuser U to the kiosk terminal 10 which has transmitted a comparisonrequest. The comparison information indicates that there is a matchingin the comparison or there is no matching in the comparison. That is,the comparison information indicates that a captured face image and apassport face image are matched and identity verification of the user Uperforming customs declaration succeeded or that a captured face imageand a passport face image are not matched and identity verification ofthe user U failed as a result of the comparison.

Further, the CPU 502 functions as a determination unit that, when userinformation on the user U is received from the kiosk terminal 10,determines the declaration detail included in declaration information onthe user U. The CPU 502 as the determination unit determines from thedeclaration detail included in declaration information on the user Uwhether or not the user U is taxable or whether or not there is a riskin the user U. A case where the user U is taxable and a case where thereis a risk in the user U are the same as described above, respectively.

Further, the CPU 502 functions as a transmission unit that transmitsdetermination information indicating a determination result of thedeclaration detail included in the declaration information on the user Uto the kiosk terminal 10 that has transmitted user information. Thedetermination information indicates whether or not the user U is taxableor whether or not there is a risk in the user U as a result of thedetermination, as described above.

The CPU 502 functions as an information management unit that stores andmanages user information on the user U received from the kiosk terminal10 in the storage device 506. The CPU 502 as the information managementunit registers and manages user information received from the kioskterminal 10 in the user information DB 506 a stored in the storagedevice 506. The CPU 502 registers the received user information to theuser information DB 506 a every time receiving user information from thekiosk terminal 10.

As described above, user information on the user U includes identityrelated information, face information, and declaration information onthe user U associated with each other. Face information corresponds to acaptured face image and a passport face image or face feature amountsextracted therefrom acquired by the kiosk terminal 10. A captured faceimage or a passport face image registered in the user information DB 506a is used as a registered face image, which corresponds to registeredbiometrics information registered in advance. While both a captured faceimage and a passport face image can be used as a registered face image,a captured face image that is newer than a passport face image may beused as a registered face image. The registered face image, which is acaptured face image or a passport face image registered in the userinformation DB 506 a, or the face feature amount thereof is used in facerecognition for identity verification of the user U at the electronicgate 20.

Further, when gate availability information is received from the kioskterminal 10, the CPU 502 registers the gate usage availability to theuser information DB 506 a in association with the user information. Thegate availability information is information indicating a determinationresult of the availability of the electronic gate 20 for the user U whoperforms customs declaration, as described above.

Note that the CPU 502 may also register user information on the user Uwho is determined to be allowed to use the electronic gate 20 to theuser information DB 506 a based on the gate availability information.That is, the CPU 502 may not register user information on the user U whois determined to be not allowed to use the electronic gate 20 to theuser information DB 506 a.

Further, the CPU 502 may also determine whether or not the user U isallowed to use the electronic gate in a similar manner to the kioskterminal 10 and acquire gate availability information instead ofreceiving gate availability information from the kiosk terminal 10.

Further, the CPU 502 can delete user information in the user informationDB 506 a from the registration after a certain time period has elapsed.For example, the CPU 502 can delete user information after a time periodnormally required from completion of customs declaration on the kioskterminal 10 to passage of the electronic gate 20 in the custominspection site C has elapsed.

Further, when a comparison request that requests face recognition of theuser U from the exit gate terminal 40 is received, the CPU 502 functionsas a comparison unit that performs face recognition of the user U. TheCPU 502 as the comparison unit compares, at 1:N, the first target faceimage or the second target face image or the face feature amount thereofwith a plurality of registered face images registered in the userinformation DB 506 a or the face feature amount thereof. The CPU 502 cancompare both face images by comparing the face feature amount extractedfrom the first target face image or the second target face image withthe face feature amount extracted from the registered face images in thecomparison between the first target face image or the second target faceimage and the registered face images.

The CPU 502 as the comparison unit attempts to find a registered faceimage matching the first target face image or the second target faceimage from a plurality of registered face images by comparison betweenthe first target face image or the second target face image and theplurality of registered face images. Further, the CPU 502 attempts tofind a face feature amount of a registered face image matching the facefeature amount of the first target face image or the second target faceimage from a plurality of face feature amounts of registered face imagesby comparison between the face feature amount of the first target faceimage or the second target face image and the plurality of face featureamount of registered face images. Note that a case where the firsttarget face image or the second target face image and the registeredface image are matched includes a case where a comparison scoreindicating the similarity between both face images exceeds apredetermined threshold and both the face images exhibit a highsimilarity. Further, a case where a face feature amount of the firsttarget face image or the second target face image and a face featureamount of the registered face image are matched includes a case where acomparison score indicating the similarity between both face featureamounts exceeds a predetermined threshold and both the face featureamounts exhibit a high similarity.

The CPU 502 functions as a transmission unit that transmits comparisoninformation indicating a result of comparison to the exit gate terminal40 that has transmitted a comparison request. The comparison informationindicates that there is a matching in the comparison or there is nomatching in the comparison. That is, the comparison informationindicates that a registered face image matching the first target faceimage or the second target face image was found and identityverification of the user U succeeded or that no matching registered faceimage was found and identity verification of the user U failed as aresult of the comparison. Further, the comparison information indicatesthat a face feature amount of a registered face image matching the facefeature amount of the first target face image or the second target faceimage was found and identity verification of the user U succeeded orthat no matching face feature amount of a registered face image wasfound and identity verification of the user U failed as a result of thecomparison. Note that the CPU 502 may compare the first target faceimage or the second target face image or the face feature amount thereofwith a single registered face image or the face feature amount thereof.

The CPU 502 can delete a registered face image which matches the firsttarget face image or the second target face image or user informationincluding the registered face image from the user information DB 506 a.Further, the CPU 502 can delete a face feature amount of the registeredface image which matches the face feature amount of the first targetface image or the second target face image or user information includingthe face feature amount of that registered face image from the userinformation DB 506 a.

Further, the CPU 502 functions as a transmission unit that transmitsgate availability information to the exit gate terminal 40, ifnecessary.

The storage device 506 is formed of a storage medium such as anon-volatile memory, a hard disk drive, or the like and functions as astorage unit. The storage device 506 stores a program executed by theCPU 502, data referenced by the CPU 502 when the program is executed, orthe like.

Further, the storage device 506 stores the user information DB 506 a. Aplurality of pieces of user information on a plurality of users U whohave performed customs declaration by using the kiosk terminal 10 areregistered in the user information DB 506 a. Further, gate availabilityinformation on the user U is registered in the user information DB 506 ain association with the user information.

The communication unit 508 is connected to the network NW and transmitsand receives data via the network NW. The communication unit 508communicates with the kiosk terminal 10, the exit gate terminal 40, orthe like under the control of the CPU 502.

In such a way, the management server 50 is configured.

The kiosk terminal 10 in accordance with the present example embodimentby causing the camera 116 provided between the display 110 and both thepassport reading device 112 and the code reading device 114 to capturethe user U who operates the kiosk terminal 10. The user U will face thecamera 116 when looking at the display 110, holding the passport overthe passport reading device 112, or holding the mobile terminal 60 overthe code reading device 114. Thereby, the kiosk terminal 10 captures theface of the user U by the camera 116 and acquires a captured face imageduring the reading, namely, in parallel to reading of a passport by thepassport reading device 112 or reading of a declaration code by the codereading device 114. Since the user U necessarily faces the camera 116provided between the display 110 and both the passport reading device112 and the code reading device 114, it is not necessary to instruct theuser U to suspend the operation on the kiosk terminal 10 and face thecamera 116. Further, the kiosk terminal 10 can perform reading of apassport by the passport reading device 112 or reading of a declarationcode by the code reading device 114 at the same time or in any order.

Therefore, according to the kiosk terminal 10 of the present exampleembodiment, procedures on the kiosk terminal 10 including reading of apassport, reading of a declaration code, and acquisition of a capturedface image used in face recognition can be completed in a short time.Further, since the kiosk terminal 10 can capture the face of the user Uduring reading of a passport or a declaration code, this does not causethe user U to be aware of the capturing, and therefore a mental burdenon the user U can be reduced.

Further, the exit gate terminal 40 of the electronic gate 20 accordingto the present example embodiment compares the first target face image,which is acquired by causing the first camera 410 to capture the user Umoving toward the exit gate terminal 40, with registered face imagesregistered in the user information DB 506 a of the management server 50.The first target face image can be acquired without the user U stopping.Therefore, according to the electronic gate 20 of the present exampleembodiment, face recognition of the user U can be effectively performedby using the first target face image. This can reduce the time requiredfor the user U to pass through the electronic gate 20. Further, whenthere is no matching in a comparison of the first target face image orthe comparison is unable to be performed, the exit gate terminal 40compares the second target face image, which is acquired by causing thesecond camera 412, with registered face images to capture the user Ustopping in front of the exit gate doors 414. Therefore, according tothe electronic gate 20 of the present example embodiment, identityverification by face recognition of the user U can be reliablyperformed.

Furthermore, the exit gate terminal 40 of the electronic gate 20according to the present example embodiment opens the exit gate doors414 in accordance with a determination result of the gate usageavailability determined in advance. Therefore, according to theelectronic gate 20 of the present example embodiment, the time requiredfor passage of the electronic gate 20 by the user U can be reduced.

The operation of each component in the information processing system 1according to the present example embodiment and a control method thatrealizes the operation will be further described below by using FIG. 15Ato FIG. 20.

First, the operation of the kiosk terminal 10 will be described by usingFIG. 15A to FIG. 18C together with the operation of the managementserver 50. FIG. 15A is a schematic diagram illustrating one example of adeclaration information entry window on the mobile terminal 60. FIG. 15Bis a schematic diagram illustrating one example of a declaration codedisplay window on the mobile terminal 60. FIG. 16 is a sequence diagramillustrating the operation of the kiosk terminal 10 and the managementserver 50. FIG. 17 is a sequence diagram illustrating a language settingoperation of the kiosk terminal 10. FIG. 18A is a schematic diagramillustrating one example of a reception window on the kiosk terminal 10.FIG. 18B is a schematic diagram illustrating one example of adeclaration detail confirmation window on the kiosk terminal 10. FIG.18C is a schematic diagram illustrating one example of a guide window onthe kiosk terminal 10.

For example, the user U who arrived at an airport from a foreign countryby an airplane goes through immigration at an immigration site,reception of deposited baggage at a baggage claim site, or the like andmoves to the custom inspection site C to carry out customs declaration.The user U inputs declaration information on a customs declarationapplication executed on the mobile terminal 60 to generate and display adeclaration code including declaration information. Note that the user Umay generate and display the declaration code before using the kioskterminal 10.

FIG. 15A illustrates a declaration information entry window SHE of thecustoms declaration application on the mobile terminal 60. Thedeclaration information entry window SHE has a declaration informationentry field SHE10 for entry of information to be declared in declarationin baggage clearance, for example. In the declaration information entryfield SHE10, information to be declared in the declaration by CustomsForm C No. 5360, Export/Import Declaration for Consigned Articles(Accompanied Articles/Unaccompanied Articles) in a case of declarationin Japan can be input, for example. That is, the declaration informationentry field SHE10 can accept entry of boarding information, which isinformation regarding boarding of the user U such as a flight number, anorigin, a date of entry and answers to questions. Note that, in thecustoms declaration application, basic information on the user U, whichdoes not change for each customs declaration, such as the name, thecurrent address, the telephone number, the birthday, the passportnumber, or the like of the user U out of the declaration information canbe input in a user registration window (not illustrated) or a settingwindow (not illustrated) and registered in advance.

FIG. 15B illustrates a declaration code display window SHC of thecustoms declaration application on the mobile terminal 60. Thedeclaration code display window SHC has a declaration code display fieldSHC10 in which a declaration code including declaration informationinput in the declaration information entry window SHE is generated anddisplayed. The declaration code displayed in the declaration codedisplay field SHC10 further includes language information regarding ause language in the customs declaration application in addition todeclaration information. Further, in the declaration code display filedSHC10, date and time that is the term of validity of a declaration code,description of how to use a declaration code, or the like can bedisplayed.

The user U who has entered the customs inspection site C performscustoms declaration on the kiosk terminal 10 installed near the entranceof the customs declaration site C. Note that the user U may generate anddisplay a declaration code on the mobile terminal 60 before coming infront of the kiosk terminal 10. At this time, the user U may referenceguide such as description of how to use a declaration code displayed onthe customs declaration application of the mobile terminal 60,description of how to proceed the procedure on the kiosk terminal 10displayed on the digital signage terminal 70 installed near the kioskterminal 10, or the like.

As illustrated in FIG. 16, the CPU 102 of the kiosk terminal 10continuously determines whether or not a passport is held over thepassport reading device 112 or a declaration code is held over the codereading device 114, respectively (step S102). In such a way, the CPU 102waits until at least one of a passport and a declaration code is heldover (step S102, NO).

FIG. 18A illustrates one example of a reception window SKR displayed onthe display 110 on the kiosk terminal 10 that is waiting for at leastone of a passport and a declaration code to be held over by the user U.The reception window SKR displays that a declaration code is requiredfor use of the kiosk terminal 10 and description of how to hold apassport and a declaration code over, for example.

As illustrated in FIG. 16, if it is determined that a passport is heldover (step S102, YES), the CPU 102 reads and acquires passportinformation on the user U from the passport, such as identity relatedinformation, a passport face image, or the like by the passport readingdevice 112 (step S104). Further, if it is determined that a declarationcode is held over (step S102, YES), the CPU 102 reads and acquiresdeclaration information and language information from the declarationcode by the code reading device 114 (step S106).

Note that the user U may hold the passport over the passport readingdevice 112 to cause the passport to be read earlier than reading of thedeclaration code, or may hold the declaration code over the code readingdevice 114 and cause the declaration code to be read earlier thanreading of the passport. Further, the user U may hold the passport andthe declaration code over the passport reading device 112 and the codereading device 114 at the same time and cause the passport and thedeclaration code to be read, respectively. The CPU 102 can performreading of a passport by the passport reading device 112 and reading ofa declaration code by the code reading device 114 in any order or at thesame time in accordance with the timing when the user U causes thepassport and the declaration code to be read.

Further, the CPU 102 can suspend a process when it is detected that acertain time period has elapsed or the user U left the kiosk terminal 10with one of the passport and the declaration code being read but thenthe other was not being held over. In such a case, the CPU 102 can causethe display 110 to display an error indication or the like or perform areset process to nullify the process performed so far, for example.Then, the CPU 102 can proceed to step S102. Note that the CPU 102 candetect that the user U left the kiosk terminal 10 based on a movingimage captured by the camera 116 or static images continuously capturedby the camera 116, for example.

Furthermore, if it is determined that a passport or a declaration codeis held over (step S102, YES), the CPU 102 causes the camera 116 tocapture the face of the user U and acquires a captured face image of theuser U (step S108). The CPU 102 can cause the camera 116 to capture theface of the user U in parallel to reading of the passport by thepassport reading device 112 or reading of the declaration code by thecode reading device 114, namely, during reading of the passport or thedeclaration code. The camera 116 can start capturing in response to thepassport or the declaration code being held over.

In such a way, the CPU 102 causes the camera 116 to capture a face imageof the user U who causes the passport reading device 112 to read thepassport or causes the code reading device 114 to read the declarationcode in front of the kiosk terminal 10 and acquires a captured faceimage.

The camera 116 is provided such that the capturing direction thereof isa forward diagonally upward direction and has a view angle so as to beable to capture the face of the user U directing his/her eyes in theforward diagonally downward direction and looking down at display 110,the passport reading device 112, or the code reading device 114 andoperating the kiosk terminal 10, as described above. Thus, the camera116 can capture the face of the user U looking down at the display 110,the passport reading device 112, or the code reading device 114 andoperating the kiosk terminal 10 without causing the user U to be awareof the capturing. For example, it is not necessary to request the user Uto face the direction of the camera 116 in capturing by the camera 116.

Further, the camera 116 can acquire a plurality of face images for theuser U who operates the kiosk terminal 10 by capturing a moving image ata predetermined framerate or capturing static images at predeterminedtime intervals. In such a case, the CPU 102 can select and acquire aface image having the highest quality as a captured face image of theuser U out of the plurality of face images of the user U captured by thecamera 116. The camera 116 can start capturing in response to a passportor a declaration code being held over as a trigger. The quality of aface image can be evaluated with respect to the direction of the facerelative to the camera 116, for example, and a face image can beevaluated as being above a predetermined quality when the direction ofthe face relative to the camera 116 is within a predetermined range.

In response to acquiring a passport face image of the user U from apassport and acquiring a captured face image of the user U by the camera116, the CPU 102 transmits a comparison request that requests facerecognition of the user U to the management server 50 via the network NW(step S110). The CPU 102 transmits the captured face image and thepassport face image or face feature amounts thereof to the managementserver 50 together with the comparison request.

In response to receiving the comparison request from the kiosk terminal10, the CPU 502 of the management server 50 performs face recognition ofthe user U (step S112). The CPU 502 compares the captured face imagewith the passport face image at 1:1.

Next, the CPU 502 transmits comparison information indicating a resultof the comparison between the captured face image and the passport faceimage to the kiosk terminal 10 via the network NW (step S114).

In such a way, face recognition of the user U to compare the capturedface image with the passport face image is performed while the user U isoperating the kiosk terminal 10.

Note that, when there is no matching in the comparison between thecaptured face image and the passport face image, the kiosk terminal 10can re-capture a captured face image by again performing step S108 ofcausing the camera 116 to capture the face of the user U and acquiring acaptured face image of the user U. The kiosk terminal 10 can performre-capturing of a captured face image once or multiple times.

Further, the CPU 102 sets a use language on the kiosk terminal 10 forconfirmation and, if necessary, correction of the declaration detail bythe user U (step S116). In setting of a use language, first, the CPU 102acquires language information read from a declaration code, asillustrated in FIG. 17 (step S202).

Next, the CPU 102 sets a use language in the customs declarationapplication indicated by the acquired language information as a uselanguage on the kiosk terminal 10 (step S204). Here, the use language inthe customs declaration application set as a use language on the kioskterminal 10 is a language set in the language setting in the mobileterminal 60 or, if a language is set in setting in the customsdeclaration application, the set language. Thereby, the CPU 102 cancause the display 110 to display various information in the same uselanguage as the use language in the customs declaration application ofthe mobile terminal 60 used by the user U. Further, the CPU 102 canaccept input by the user U from the input device 108 such as atouchscreen embedded in the display 110 in the same use language as theuse language in the customs declaration application of the mobileterminal 60 used by the user U.

Further, the CPU 102 determines whether or not there is entry of achange instruction by the user U via the input device 108 to instruct achange to another language of use languages (step S206). If there is noentry of a change instruction (step S206, NO), the CPU 102 maintains theuse language set in step S204.

If there is entry of a change instruction (step S206, YES), the CPU 102changes the use language of the kiosk terminal 10 to another languageinstructed by the change instruction (step S208).

In such a way, even when the user U is a foreigner, the user U is ableto confirm the displayed content and input information in the languagewhich the user U uses on the kiosk terminal 10 by himself/herself or thelanguage which the user U instructs the kiosk terminal 10 to change byhimself/herself. Thus, the user U is able to use the kiosk terminal 10smoothly without the language being an obstacle.

After setting the use language on the kiosk terminal 10, the CPU 102displays the declaration detail of declaration information read from thedeclaration code on the display 110 to have the user U confirm thedeclaration detail as illustrated in FIG. 16 and accepts correction fromthe user U, if necessary (step S118). The user U confirms thedeclaration detail displayed on the display 110 and corrects thedeclaration detail via the input device 108 if it is necessary tocorrect the declaration detail. The user U who has confirmed thedeclaration detail inputs a finalization instruction to finalize thedeclaration detail via the input device 108. Thereby, the declarationdetail declared by the user U in customs declaration is finalized.

FIG. 18B illustrates one example of the declaration detail confirmationwindow SKC displayed on the display 110 of the kiosk terminal 10 onwhich confirmation of the declaration detail and correction, ifnecessary, are performed by the user U. The declaration detailconfirmation window SKC displays the declaration detail included indeclaration information. For example, in response to a correction buttonbeing pressed by touch entry by the user U, the declaration detailconfirmation window SKC can be transitioned to a declaration detailcorrection window on which correction of the declaration detail isenabled. Further, on the declaration detail confirmation window SKC, inresponse to a confirmation button being pressed by the touch input bythe user U, the finalization instruction is input to the kiosk terminal10, for example. Thereby, the declaration detail declared by the user Uin the customs declaration is finalized.

Note that the CPU 102 can display the declaration detail confirmationwindow SKC in which the layout is the same as the declarationinformation entry window SHE of the customs declaration applicationillustrated in FIG. 15A displayed on the display 610 of the mobileterminal 60. With the same layout being used for both windows, it ispossible to realize window display where the user U is less likely to beconfused in the operation of the kiosk terminal 10.

When the declaration detail is finalized, the CPU 102 transmits userinformation on the user U to the management server 50 via the networkNW, as illustrated in FIG. 16 (step S120). The user information includesidentity related information, face information, and declarationinformation on the user U associated with each other. Note that, sinceCPU 102 transmits the captured face image and the passport face imagetogether with the comparison request in step S110, face information ofthe user information may not be transmitted again.

Next, the CPU 502 determines the declaration detail included indeclaration information of user information on the user U (step S122).The CPU 502 determines whether or not the user U is taxable or whetheror not there is a risk in the user U from the declaration detailincluded in the declaration information on the user U.

Furthermore, the CPU 502 can perform comparison of the passport numberin addition to determination of the declaration detail. In such a case,the CPU 502 compares a passport number included in the identity relatedinformation in the user information with a passport number included inthe declaration information in the user information.

Next, the CPU 502 transmits determination information indicating adetermination result of the declaration detail included in thedeclaration information on the user U to the kiosk terminal 10 via thenetwork NW (step S124). Further, the CPU 502 can include the comparisonresult of the passport numbers in the determination information.

In response to receiving the determination information from themanagement server 50, the CPU 102 of the kiosk terminal 10 determineswhether or not the user U is allowed to use the electronic gate 20 basedon the received determination information and the previously receivedcomparison information (step S126). The previously received comparisoninformation is the information transmitted from the management server 50in step S114. Note that the CPU 102 can cause the display 110 to displayand indicate the comparison information indicating a result of thecomparison between the captured face image and the passport face imageand the determination information indicating a determination result ofthe declaration detail to the user U.

When the passport face image and the captured face image of the user Uare matched, the user U is not taxable, and there is no risk in the userU, the CPU 102 determines that the user U is allowed to use theelectronic gate 20. When the determination information includes acomparison result of the passport numbers, the CPU 102 determines thatthe user U is allowed to use the electronic gate 20 when the passportface image and the captured face image of the user U are matched, theuser U is not taxable, there is no risk in the user U, and the passportnumbers are matched.

On the other hand, when the passport face image and the captured faceimage of the user U are not matched, the user U is taxable, or there isa risk in the user U, the CPU 102 determines that the user U is notallowed to use the electronic gate 20. Further, when the determinationinformation includes a comparison result of the passport numbers, theCPU 102 determines that the user U is not allowed to use the electronicgate 20 also when the passport numbers are not matched.

The CPU 102 transmits gate availability information indicating thedetermination result of the availability of the electronic gate 20 tothe management server 50 (step S128). The gate availability informationindicates that the user U is allowed to use the electronic gate 20 whenthe passport face image and the captured face image of the user U arematched, the user U is not taxable, and there is no risk in the user U.Further, when the determination information includes a comparison resultof the passport numbers, the gate availability information indicatesthat the user U is allowed to use the electronic gate 20 when thepassport numbers are matched.

In response to receiving the gate availability information from thekiosk terminal 10, the CPU 502 of the management server 50 registersuser information on the user U to the user information DB 506 a inassociation with the gate availability information (step S130). Notethat the CPU 502 may determine whether or not the user U is allowed touse the electronic gate 20 based on comparison information anddetermination information in a similar manner to the CPU 102 of thekiosk terminal 10 instead of receiving the gate availability informationfrom the kiosk terminal 10.

Further, the CPU 502 may register user information on a particular userU to the user information DB 506 a instead of registering userinformation to the user information DB 506 a in association with thegate availability information. That is, the CPU 502 may register userinformation on the user U who is determined to be allowed to use theelectronic gate 20 to the user information DB 506 a based on the gateavailability information. That is, the CPU 502 may not register userinformation on the user U other than the particular user U to the userinformation DB 506 a.

Next, if it is determined that the user U is allowed to use theelectronic gate 20 (step S132, YES), the CPU 102 of the kiosk terminal10 performs a process to guide the user U to the electronic gate 20(step S134). For example, the CPU 102 causes the display 110 to displaya guide window, which guides the user U to the electronic gate 20, andguide the user U to the electronic gate 20.

FIG. 18C illustrates one example of a guide window SKG displayed on thedisplay 110 of the kiosk terminal 10 to guide the user U to theelectronic gate 20. For example, the guide window SKG indicates a text,a symbol, a picture, or the like indicating that the customs declarationis completed together with a text, a symbol, a picture, or the like toguide the user U to the electronic gate 20.

On the other hand, if it is determined that the user U is not allowed touse the electronic gate 20 (step S132, NO), the CPU 102 performs acountermeasure process on the user who is not allowed to use theelectronic gate 20 (step S136). For example, the CPU 102 causes thedisplay 110 to display a guide window, which guides the user U to themanned booth M, and guide the user U to the manned booth M as thecountermeasure process.

In such a way, customs declaration by the user U is performed on thekiosk terminal 10.

Next, the operation of the electronic gate 20 to which the user U isguided by the kiosk terminal 10 will be described by using FIG. 19 andFIG. 20 together with the operation of the management server 50. FIG. 19is a sequence diagram illustrating the operations of the entrance gateterminal 30 and the exit gate terminal 40 forming the electronic gate 20and the management server 50.

In a standby state of the electronic gate 20 in which no user U hasentered the gate passage P, the entrance gate doors 308 of the entrancegate terminal 30 are in an opened state, and the exit gate doors 414 ofthe exit gate terminal 40 are in a closed state. Furthermore, in thestandby state, the guide indicators 314 of the entrance gate terminal 30display an indication indicating permission of entry to the gate passageP, the guide indicators 420 of the exit gate terminal 40 display anindication indicating prohibition of exit from the gate passage P.

The user U who has complete customs declaration on the kiosk terminal 10and been guided to the electronic gate 20 will pass through the entrancegate terminal 30 with the opened entrance gate doors 308 and enter thegate passage P.

As illustrated in FIG. 19, in the standby state, the CPU 302 of theentrance gate terminal 30 determines whether or not the user U haspassed through the entrance gate terminal 30 and entered the gatepassage P (step S302) and waits for passage of the user U (step S302,NO). The CPU 302 can determine whether or not the user U has passedthrough the entrance gate terminal 30 and entered the gate passage Pbased on the output signals from the plurality of the passage detectionsensors 310 and the output order thereof.

If the CPU 302 determines that the user U has passed through theentrance gate terminal 30 and entered the gate passage P (step S302,YES), the CPU 302 closes the entrance gate doors 308 (step S304).Further, the CPU 302 changes the indication of the guide indicators 314from the indication indicating permission of entry to the gate passage Pto an indication indicating prohibition of entry to the gate passage P.

The entrance gate doors 308 are controlled so as not to be opened untilthe user U who has entered the gate passage P passes through the exitgate terminal 40 and exits the gate passage P, as described later. Thus,only a single user U can enter the gate passage P. Thereby, a situationwhere a plurality of users U are captured by the first camera 410 can beprevented, and a comparison of the first target face image can bereliably performed.

Further, the CPU 302 transmits, to the exit gate terminal 40, entrancepassage information indicating that the user U has passed through theentrance gate terminal 30 and entered the gate passage P (step S306).Note that the CPU 302 can perform one of step S304 and step S306 inearlier order than the other or can perform both steps S304 and S306 atthe same time.

The CPU 402 of the exit gate terminal 40 that has received the entrancepassage information from the entrance gate terminal 30 causes the firstcamera 410 to capture the user U who moves toward the exit gate terminal40 on the gate passage P and acquires the first target face image of theuser U (step S308). The first camera 410 captures a moving image at apredetermined framerate or captures static images at predeterminedintervals to acquire a plurality of first target face images for theuser U who moves on the gate passage P. In such a way, the first targetface image, which is a face image of the user U moving on the gatepassage P, is captured. During capturing by the first camera 410, theuser U is able to move toward the exit gate terminal 40 without stoppingon the gate passage P.

During capturing by the first camera 410, the CPU 402 performsline-of-sight detection on the first target face image and, in responseto determining that the user U is looking down or looking away as aresult of the line-of-sight detection, can warn the user U to faceforward, namely, toward the exit gate terminal 40 side. The CPU 402 canwarn the user U to face forward by display on the display 408, a voicefrom a speaker or the like, or the like, for example. Thereby, the firsttarget face image having a higher quality can be more reliably acquired.

When the user U does not face forward against the warning describedabove, the CPU 402 may neither perform the quality determination in stepS310 nor the comparison request in the step S312 described later and maynot perform comparison of the first target face image.

Further, during capturing by the first camera 410, the CPU 402 performswearing item estimation on the captured first target face image andattempts to detect a wearing item on the face, such as sunglasses,glasses, a hat, or the like, in the first target face image. When awearing item on the face is detected, the CPU 402 can perform warningthat instructs the user U to put off the wearing item on the face bydisplay on the display 408, a voice from a speaker or the like, or thelike, for example. Thereby, it is possible to remove a factor which mayprevent comparison of the first target face image.

When the wearing item on the face is not put off from the face of theuser U against the warning described above, the CPU 402 may neitherperform the quality determination in step S310 nor the comparisonrequest in the step S312 described later and may not perform comparisonof the first target face image.

The CPU 402 calculates a quality value for each of the acquired firsttarget face images and determines the quality of the first target faceimage based on the calculated quality value (step S310).

The CPU 402 sequentially transmits comparison requests to the managementserver 50 via the network NW for high quality first target face imagesabove a certain quality as a result of the quality determination (stepS312). Thereby, the CPU 402 requests the management server 50 tocompare, at 1:N, the first target face image above the certain qualitywith a plurality of registered face images registered in the userinformation DB 506 a of the management server 50. The CPU 402 transmitsa face feature amount extracted from the first target face image or thefirst target face image itself to the management server 50 together withthe comparison request.

Note that the CPU 402 may transmit all the acquired first target faceimages to the management server 50 regardless of the quality. In such acase, the CPU 502 of the management server 50 can perform the qualitydetermination on the first target face images in the same manner andperform comparison with the registered face image for the first targetface images above a certain quality. Further, the CPU 502 can performcomparison between the first target face images and the registered faceimage regardless of the quality.

In response to receiving the comparison request of the first target faceimage from the exit gate terminal 40, the CPU 502 of the managementserver 50 performs comparison of the first target face image (stepS314). The CPU 502 compares, at 1:N, the face feature amount of thefirst target face image received from the exit gate terminal 40 with aplurality of registered face images registered in the user informationDB 506 a. The face feature amount of the first target face image is thatreceived from the exit gate terminal 40 or that extracted from the firsttarget face image received from the exit gate terminal 40.

Next, the CPU 502 transmits comparison information indicating a resultof the comparison of the first target face image to the exit gateterminal 40 via the network NW (step S316).

The CPU 402 of the exit gate terminal 40 and the CPU 502 of themanagement server 50 can repeat and perform steps S312, S314, and S316described above for a plurality of first target faced images above acertain quality.

The CPU 402 of the exit gate terminal 40 receives comparison informationfrom the management server 50. If the comparison information on any ofthe first target face images indicates that a matching registered faceimage was found and identity verification of the user U moving the gatepassage P succeeded (step S318, YES), the CPU 402 ends capturing by thefirst camera 410. Subsequently, the CPU 402 proceeds to step S336.

On the other hand, if the comparison information on all the first targetface images indicates that no matching registered face image was foundand identity verification of the user U failed by a predetermined pointof time (step S318, NO), the CPU 402 determines that identityverification by the comparison of the first target face image failed.Note that the predetermined point of time is a point of time when theuser U reaches the exit gate doors 414 of the exit gate terminal 40, forexample. The CPU 402 can determine whether or not the user U has reachedthe exit gate doors 414 from an image captured by the first camera 410.

Further, when no comparison information is received by the samepredetermined point of time as described above, the CPU 402 candetermine that identity verification by the comparison of the firsttarget face image failed. In such a case, the first target face imageabove the certain quality cannot be acquired, no comparison between thefirst target face image and the registered face image may be performed.

If the CPU 402 determines that the identity verification by thecomparison of the first target face image failed, the CPU 402 notifiesthe user U that capturing by the second camera 412 is to be performed(step S320). That is, when there is no matching in the comparisonbetween the first target face image and the registered face image or thecomparison is unable to be performed, the CPU 402 notifies the user Uthat capturing by the second camera 412 is performed. For example, theCPU 402 can notify that capturing by the second camera 412 is to beperformed by display on the display 408, voice guidance, or the like.

Next, the CPU 402 causes the second camera 412 to capture of the user Uwho stops in front of the exit gate doors 414 in response to thenotification (step S322). Thereby, the CPU 402 acquires the secondtarget face image of the user U who reaches in front of the exit gatedoors 414 of the exit gate terminal 40 and stops in front of the exitgate doors 414. In such a way, the second target face image, which is aface image of the user U who stops in front of the exit gate doors 414,is acquired.

The second camera 412 can acquire a plurality of face images for theuser U in front of the exit gate doors 414 by capturing a moving imageat a predetermined framerate or capturing static images at predeterminedintervals. In such a case, the CPU 402 can select and acquire the faceimage of the highest quality as the second target face image of the userU out of the plurality of face images of the user U captured by thesecond camera 412.

The CPU 402 can guide the user U by display on the display 408, voicefrom a speaker or the like, or the like, for example, in capturing bythe second camera 412. For example, if a wearing item on the face isdetected in the second target face image, the CPU 402 can guide the userto put off the wearing item on the face or face the direction of thesecond camera 412 or the display 408 or the like.

FIG. 20 illustrates one example of a guide window displayed on thedisplay 408 in capturing by the second camera 412. As illustrated, withthe display on the display 408, it is possible to guide the user U toput off a mask, which is a wearing item on the face.

Next, the CPU 402 transmits a comparison request to the managementserver 50 via the network NW for the second target face image (stepS324). Thereby, the CPU 402 requests the management server 50 tocompare, at 1:N, the second target face image with a plurality ofregistered face images registered in the user information DB 506 a ofthe management server 50. The CPU 402 transmits a face feature amountextracted from the second target face image or the second target faceimage itself to the management server 50 together with the comparisonrequest.

In response to receiving the comparison request of the second targetface image from the exit gate terminal 40, the CPU 502 of the managementserver 50 performs comparison of the second target face image (stepS326). The CPU 502 compares, at 1:N, the face feature amount of thesecond target face image received from the exit gate terminal 40 withfeature amounts of a plurality of registered face images registered inthe user information DB 506 a. The face feature amount of the secondtarget face image is that received from the exit gate terminal 40 orthat extracted from the second target face image received from the exitgate terminal 40.

Next, the CPU 502 transmits comparison information indicating a resultof the comparison of the second target face image to the exit gateterminal 40 via the network NW (step S328).

The CPU 402 of the exit gate terminal 40 receives comparison informationfrom the management server 50. If the comparison information on thesecond target face images indicates that a matching registered faceimage was found and identity verification of the user U in front of theexit gate doors 414 succeeded (step S330, YES), the CPU 402 proceeds tostep S336.

Note that, when there is no matching in the comparison between thesecond target face image and the registered face image, the exit gateterminal 40 can re-capture a second target face image by againperforming step S322 of causing the second camera 412 to capture theuser U to acquire the second target face image of the user U. The exitgate terminal 40 can perform re-capturing of the second target faceimage once or multiple times.

Further, if identity verification of the user U is successful as aresult of the comparison of the first target face image or thecomparison of the second target face image (step S332, YES), the CPU 502of the management server 50 performs transmission of gate availabilityinformation (step S334). That is, the CPU 502 acquires gate availabilityinformation associated with user information on the user U whoseidentity verification succeeded from the user information DB 506 a andtransmits the gate availability information to the exit gate terminal 40via the network NW.

If the comparison information on the second target face image indicatesthat no matching registered face image was found and identityverification of the user U failed (step S330, NO), the CPU 402 of theexit gate terminal 40 performs a countermeasure process (step S338).This case means that the identity verification of the user U failed withboth of the comparison of the first target face image and the comparisonof the second target face image. To call a customs officer to the gatepassage P as a countermeasure process, the CPU 402 can sound an alarm ortransmit a notification to a terminal of the custom officer, forexample. In such a case, the customs officer may guide the user U to themanned booth M or a separate room, for example. Further, the customsofficer may perform face-to-face customs inspection at an inspectionstage provided on the side of the electronic gate 20 and then let theuser U exit the gate passage P from the exit gate doors 414 that ismanually opened.

On the other hand, the CPU 402 that proceeds to step S336 after theidentity verification of the user U succeeded with the comparison of thefirst target face image or the comparison of the second target faceimage determines whether or not the user U who succeeded in the identityverification is allowed to use the electronic gate 20 (step S336). TheCPU 402 determines the usage availability of the electronic gate 20based on the gate availability information received from the managementserver 50.

If the CPU 402 determines that the electronic gate 20 is not allowed tobe used (step S336, NO), the CPU 402 performs a countermeasure process(step S338). In such a case, the user U is a person who is determined astaxable, a person determined as risky, or the like while identityverification of the user U is successful by the comparison of the firsttarget face image or the second target face image. To call a customsofficer to the gate passage P as a countermeasure process, the CPU 402can sound an alarm or transmit a notification to a terminal of thecustom officer, for example. Also in this case, the customs officer isable to handle the user U in the same manner as described above.

On the other hand, if the CPU 402 determines that the electronic gate 20is allowed to be used (step S336, YES), the CPU 402 opens the exit gatedoors 414 (step S340). Further, the CPU 402 changes the indication ofthe guide indicators 420 from an indication indicating prohibition ofexit from the gate passage P to an indication indicating permission ofexit from the gate passage P.

Next, the CPU 402 determines whether or not the user U has passedthrough the exit gate terminal 40 and exited the gate passage P (stepS342) and waits for passage of the user U (step S342, NO). The CPU 402can determine whether or not the user U has passed through the exit gateterminal 40 and exited the gate passage P based on the output signalsfrom the plurality of passage detection sensors 416 and the output orderthereof.

If the CPU 402 determines that the user U has passed through the exitgate terminal 40 and exited the gate passage P (step S342, YES), the CPU402 closes the exit gate doors 414 (step S344). Further, the CPU 402changes the indication of the guide indicators 420 from an indicationindicating permission of exit from the gate passage P to an indicationindicating prohibition of exit from the gate passage P.

Further, the CPU 402 transmits, to the entrance gate terminal 30, exitpassage information indicating that the user U has passed through theexit gate terminal 40 and exited the gate passage P (step S346). Notethat the CPU 402 can perform one of step S344 and step S346 in earlierorder than the other or can perform both steps S344 and S346 at the sametime.

The CPU 302 of the entrance gate terminal 30 that received the exitpassage information from the exit gate terminal 40 opens the entrancegate doors 308 (step S348). Further, the CPU 302 changes the indicationof the guide indicators 314 from an indication indicating prohibition ofentry to the gate passage P to an indication indicating permission ofentry to the gate passage P.

In such a way, the electronic gate 20 transitions to a standby state towait for the user U entering the gate passage P.

As discussed above, according to the present example embodiment, acaptured face image used for face recognition, which is comparison ofbiometrics information, is captured during reading of a passport orreading of a declaration code on the kiosk terminal 10. Therefore,according to the present example embodiment, it is possible to completeprocedures on the kiosk terminal 10 including acquisition of informationby reading of a passport and reading of a declaration code and facerecognition using the captured face image in a short time.

Further, according to the present example embodiment, in the exit gateterminal 40 of the electronic gate 20, the user U who moves toward theexit gate terminal 40 is captured by the first camera 410 to acquire afirst target face image used for face recognition, which is comparisonof biometrics information. Further, according to the present exampleembodiment, the exit gate doors 414 is opened in accordance with adetermination result of gate usage availability determined in advance.Therefore, according to the present example embodiment, the timerequired for the user U to pass through the electronic gate 20 can bereduced.

Other Example Embodiments

According to another example embodiment, the gate apparatus described inthe example embodiment described above can be configured as illustratedin FIG. 21 and FIG. 22. FIG. 21 and FIG. 22 are schematic diagramsillustrating the configuration of an information processing apparatusaccording to other example embodiments, respectively.

As illustrated in FIG. 21, the gate apparatus 1000 according to anotherexample embodiment has an exit gate door 1002, a first biometricsinformation acquisition unit 1004, and a second biometrics informationacquisition unit 1006, and a door control unit 1008. The firstbiometrics information acquisition unit 1004 acquires, from a user whomoves toward the exit gate door 1002 in a closed state, first targetbiometrics information to be compared with registered biometricsinformation registered in advance. The second biometrics informationacquisition unit 1006 acquires second target biometrics information tobe compared with the registered biometrics information from the user whostops in front of the exit gate door 1002 when there is no matching inthe comparison between the first target biometrics information and theregistered biometrics information or the comparison is unable to beperformed. The door control unit 1008 opens the closed exit gate door1002 in accordance with a result of the comparison between the firsttarget biometrics information or the second target biometricsinformation and the registered biometrics information.

The second biometrics information acquisition unit 1006 may also beconfigured to acquire the second target biometrics information to becompared with the registered biometrics information from the user whostops in front of the exit gate door 1002 in a predetermined case inaddition to the above. The predetermined case as used herein is a casewhere the direction of the face of the user moving toward the closedexit gate door 1002 is not directed to the exit gate door 1002 or a casewhere a wearing item is worn by the face of the user.

According to the gate apparatus 1000 of the above another exampleembodiment, since the first target biometrics information to be comparedwith registered biometrics information registered in advance is acquiredfrom the user moving toward the closed exit gate door 1002, the timerequired for passage of the user can be reduced.

Further, as illustrated in FIG. 22, a gate apparatus 2000 according toanother example embodiment has an exit gate door 2002, a biometricsinformation acquisition unit 2004, and a door control unit 2006. Thebiometrics information acquisition unit 2004 acquires, from a user whomoves toward the exit gate door in a closed state or stops in front ofthe exit gate door, target biometrics information to be compared withregistered biometrics information registered in advance. The doorcontrol unit 2006 opens the closed exit gate door 2002 in accordancewith a determination result for declaration information associated withthe registered biometrics information which matches the targetbiometrics information.

According to the gate apparatus 2000 of the above another exampleembodiment, since the closed exit gate door 2002 is opened in accordancewith a determination result for declaration information associated withregistered biometrics information which matches target biometricsinformation, the time required for passage of the user can be reduced.

Modified Example Embodiments

The present invention is not limited to the example embodimentsdescribed above and various modifications are possible.

For example, while the case where customs declaration is performed onthe kiosk terminal 10 has been described as an example in the exampleembodiments described above, the invention is not limited thereto. Thekiosk terminal 10 can be configured to accept various declaration by theuser.

Further, while the case where the camera 116, the first camera 410, andthe second camera 412 capture and acquire a face image of the user U asbiometrics information on the user U has been described as an example inthe example embodiments described above, the invention is not limitedthereto. The camera 116, the first camera 410, the second camera 412 mayacquire an iris image or the like other than a face image correspondingto face information as biometrics information on the user U.

Further, the kiosk terminal 10 according to the example embodimentsdescribed above can be configured as a system formed of one or aplurality of devices. Further, the entrance gate terminal 30 accordingto the example embodiments described above can be configured as a systemformed of one or a plurality of devices. Further, the exit gate terminal40 according to the example embodiments described above can beconfigured as a system formed of one or a plurality of devices. Further,the management server 50 according to the example embodiments describedabove can be configured as a system formed of one or a plurality ofdevices.

Further, the scope of each of the example embodiments includes aprocessing method that stores, in a storage medium, a program thatcauses the configuration of each of the example embodiments to operateso as to implement the function of each of the example embodimentsdescribed above, reads the program stored in the storage medium as acode, and executes the program in a computer. That is, the scope of eachof the example embodiments also includes a computer readable storagemedium. Further, each of the example embodiments includes not only thestorage medium in which the computer program described above is storedbut also the computer program itself.

As the storage medium, for example, a floppy (registered trademark)disk, a hard disk, an optical disk, a magneto-optical disk, a compactdisc-read only memory (CD-ROM), a magnetic tape, a nonvolatile memorycard, or a ROM can be used. Further, the scope of each of the exampleembodiments includes an example that operates on (operating system) OSto perform a process in cooperation with another software or a functionof an add-in board without being limited to an example that performs aprocess by an individual program stored in the storage medium.

An example advantage according to the invention is that the timerequired for a user to pass through a gate apparatus can be reduced.

While the invention has been particularly shown and described withreference to example embodiments thereof, the invention is not limitedto these embodiments. It will be understood by those of ordinary skillin the art that various changes in form and details may be made thereinwithout departing from the spirit and scope of the present invention asdefined by the claims.

The whole or part of the example embodiments disclosed above can bedescribed as, but not limited to, the following supplementary notes.

(Supplementary Note 1)

A gate apparatus comprising:

an exit gate door;

a first biometrics information acquisition unit that acquires, from auser who moves toward the exit gate door in a closed state, first targetbiometrics information to be compared with registered biometricsinformation registered in advance;

a second biometrics information acquisition unit that acquires secondtarget biometrics information to be compared with the registeredbiometrics information from the use who stops in front of the exit gatedoor when there is no matching in a comparison between the first targetbiometrics information and the registered biometrics information or thecomparison is unable to be performed; and

a door control unit that opens the exit gate door in the closed state inaccordance with a result of a comparison between the first targetbiometrics information or the second target biometrics information andthe registered biometrics information.

(Supplementary Note 2)

The gate apparatus according to supplementary note 1, wherein the doorcontrol unit opens the exit gate door in the closed state in accordancewith a determination result for declaration information associated withthe registered biometrics information which matches the first targetbiometrics information or the second target biometrics information.

(Supplementary Note 3)

The gate apparatus according to supplementary note 2, wherein thedeclaration information is information necessary for customsdeclaration.

(Supplementary Note 4)

The gate apparatus according to any one of supplementary notes 1 to 3,

wherein the exit gate door is installed at an exit of a passage,

the gate apparatus further comprising an entrance gate door installed atan entrance of the passage and configured to be closed when the user hasentered the passage and opened when the exit gate door is opened and theuser has exited the passage.

(Supplementary Note 5)

The gate apparatus according to any one of supplementary notes 1 to 4,

wherein the first biometrics information acquisition unit acquires, asthe first target biometrics information, first target face informationto be compared with registered face information as the registeredbiometrics information from the user,

the gate apparatus further comprising a display unit that performsdisplay in accordance with a state of a face of the user who movestoward the exit gate door in the closed state.

(Supplementary Note 6)

The gate apparatus according to any one of supplementary notes 1 to 4further comprising a display unit that performs display to instruct theuser to stop in front of the exit gate door when there is no matching ina comparison between the first target biometrics information and theregistered biometrics information or the comparison is unable to beperformed.

(Supplementary Note 7)

The gate apparatus according to supplementary note 6, wherein thedisplay unit performs the display to instruct the user to stop in frontof the exit gate door and look at the display unit when there is nomatching in a comparison between the first target biometrics informationand the registered biometrics information or the comparison is unable tobe performed.

(Supplementary Note 8)

The gate apparatus according to supplementary note 5, wherein thedisplay unit performs the display in accordance with a state of a lineof sight of the user detected from the first target face information.

(Supplementary Note 9)

The gate apparatus according to supplementary note 8, wherein thedisplay unit displays the display that instructs the user to change adirection of the face.

(Supplementary Note 10)

The gate apparatus according to any one of supplementary notes 5, 8, and9, wherein when a wearing item worn by the face of the user is detected,the display unit performs the display.

(Supplementary Note 11)

The gate apparatus according to any one of supplementary notes 5, 8, and9, wherein when a wearing item worn by the face of the user is detected,the display unit performs the display to instruct the user to put offthe wearing item.

(Supplementary Note 12)

The gate apparatus according to any one of supplementary notes 1 to 11,

wherein the first biometrics information acquisition unit acquires aplurality of pieces of the first target biometrics information,

the gate apparatus further comprising a control unit that performs acomparison between the first target biometrics information above acertain quality out of the plurality of pieces of first targetbiometrics information and the registered biometrics information orrequests the comparison.

(Supplementary Note 13)

A gate apparatus comprising:

an exit gate door;

a first biometrics information acquisition unit that acquires, from auser who moves toward the exit gate door in a closed state, first targetbiometrics information to be compared with registered biometricsinformation registered in advance;

a second biometrics information acquisition unit that acquires secondtarget biometrics information to be compared with the registeredbiometrics information from the use who stops in front of the exit gatedoor when a direction of a face of the user moving toward the exit gatedoor in the closed state is not directed to the exit gate door or awearing item is worn by the face of the user; and

a door control unit that opens the exit gate door in the closed state inaccordance with a result of a comparison between the first targetbiometrics information or the second target biometrics information andthe registered biometrics information.

(Supplementary Note 14)

A gate apparatus comprising:

an exit gate door;

a biometrics information acquisition unit that acquires targetbiometrics information to be compared with registered biometricsinformation registered in advance from a user who moves toward the exitgate door in a closed state or stops in front of the exit gate door; and

a door control unit that opens the exit gate door in the closed state inaccordance with a determination result for declaration informationassociated with the registered biometrics information which matches thetarget biometrics information.

(Supplementary Note 15)

A control method of a gate apparatus having an exit gate door, thecontrol method comprising:

acquiring, from a user who moves toward the exit gate door in a closedstate, first target biometrics information to be compared withregistered biometrics information registered in advance;

acquiring second target biometrics information to be compared with theregistered biometrics information from the use who stops in front of theexit gate door when there is no matching in a comparison between thefirst target biometrics information and the registered biometricsinformation or the comparison is unable to be performed; and

opening the exit gate door in the closed state in accordance with aresult of a comparison between the first target biometrics informationor the second target biometrics information and the registeredbiometrics information.

(Supplementary Note 16)

A non-transitory storage medium storing a program that causes a gateapparatus having an exit gate door to perform:

acquiring, from a user who moves toward the exit gate door in a closedstate, first target biometrics information to be compared withregistered biometrics information registered in advance;

acquiring second target biometrics information to be compared with theregistered biometrics information from the use who stops in front of theexit gate door when there is no matching in a comparison between thefirst target biometrics information and the registered biometricsinformation or the comparison is unable to be performed; and

opening the exit gate door in the closed state in accordance with aresult of a comparison between the first target biometrics informationor the second target biometrics information and the registeredbiometrics information.

1. An apparatus comprising: a memory configured to store one or moreinstructions; and a processor configured to execute the one or moreinstructions to: control a camera device to capture a first facial imageof a person approaching a barrier using a long-range capture mode;determine whether the first facial image matches any of a plurality ofregistered facial images; control the camera device to change from thelong-range capture mode to a short-range capture mode based on thedetermination that the first facial image does not match any of theplurality of registered facial images; control the camera device tocapture a second facial image of the person using the short-rangecapture mode; output information to control the barrier to allow theperson to pass the barrier based on a determination that the secondfacial image matches one of the plurality of registered facial images;and output information to control the barrier to restrict the personfrom passing the barrier based on a determination that the second facialimage does not match any of the plurality of registered facial images.2. The apparatus of claim 1, wherein in the long-range capture mode, thefirst facial image is captured when the person is at a first location,and in the short-range capture mode the second facial image is capturedwhen the person is at a second location closer to the barrier than thefirst location.
 3. The apparatus of claim 1, wherein the camera devicecomprises: a first camera configured to capture the first facial imageof the person, and a second camera configured to capture the secondfacial image of the person.
 4. The apparatus of claim 1, the cameradevice comprises: one or more cameras configured to capture the firstfacial image and the second facial image.
 5. (canceled)
 6. The apparatusof claim 1, wherein the camera device comprises: a first cameraconfigured to capture the first facial image; a second camera configuredto capture the second facial image; and a housing configured toencompass the first camera and the second camera.
 7. The apparatus ofclaim 6, wherein the first camera is a long range camera; and whereinthe second camera is a short range camera.
 8. The apparatus of claim 1,wherein the processor is further configured to output the informationconfigured to open the barrier based on a declaration informationassociated with the registered facial image matching the second facialimage, wherein the declaration information is information for customsdeclaration.
 9. The apparatus of claim 1, wherein the processor isfurther configured to: output display information to a display apparatusto display information instructing the person to stop in front of thebarrier when there is no match between the first facial image of theperson and the plurality of registered facial images, or when thematching is unable to be performed.
 10. The apparatus of claim 1,wherein the processor is further configured to: output displayinformation to a display apparatus to display information instructingthe person to remove an item covering the face of the person when thereis no match between the first facial image of the person and theplurality of registered facial images, or when the matching is unable tobe performed.
 11. The apparatus of claim 1, wherein the processor isfurther configured to: output display information to a display apparatusto display information instructing the person to face the displayapparatus when there is no match between the first facial image of theperson and the plurality of registered facial images, or when thematching is unable to be performed.
 12. The apparatus of claim 1,further comprising: an exit gate, which is the barrier installed at anexit of a passageway at an airport terminal; and an entrance gateinstalled at an entrance of the passageway, wherein the processor isfurther configured to output information to control the entrance gate tobe closed when the person has entered the passageway and outputinformation to control the entrance gate to open when the exit gate isopened and the person has exited the passageway.
 13. The apparatus ofclaim 1, wherein the barrier is an exit gate at an airport terminal. 14.The apparatus of claim 1, wherein the information is a control signal tocontrol the barrier to open.
 15. A method of controlling a barrier, themethod comprising: controlling a camera device to capture a first facialimage of a person approaching a barrier using a long-range capture mode;determining whether the first facial image matches any of a plurality ofregistered facial images; controlling the camera device to change fromthe long-range capture mode to a short-range capture mode based on thedetermination that the first facial image does not match any of theplurality of registered facial images; controlling the camera device tocapture a second facial image of the person using the short-rangecapture mode; and outputting information to control the barrier to allowthe person to pass the barrier based on a determination that the secondfacial image matches one of the plurality of registered facial images;and outputting information to control the barrier to restrict the personfrom passing the barrier based on a determination that the second facialimage does not match any of the plurality of registered facial images.16. The method of claim 15, wherein the camera device comprises: a firstcamera configured to capture the first facial image of the person, and asecond camera configured to capture the second facial image of theperson.
 17. (canceled)
 18. The method of claim 15, wherein theoutputting of the information configured to open the barrier is furtherbased on a declaration information associated with the registered facialimage matching one of the first facial image or the second facial image.19. The method of claim 15, wherein the barrier is an exit gate at anairport terminal.
 20. The method of claim 15, wherein the information isa control signal to control the barrier to open.
 21. A non-transitorycomputer readable medium having stored thereon a program for causing acomputer to perform a method comprising: controlling a camera device tocapture a first facial image of a person approaching a barrier using along-range capture mode; determining whether the first facial imagematches any of a plurality of registered facial images; controlling thecamera device to change from the long-range capture mode to ashort-range capture mode based on the determination that the firstfacial image does not match any of the plurality of registered facialimages; controlling the camera device to capture a second facial imageof the person using the short-range capture mode; and outputtinginformation to control the barrier to allow the person to pass thebarrier based on a determination that the second facial image matchesone of the plurality of registered facial images; and outputtinginformation to control the barrier to restrict the person from passingthe barrier based on a determination that the second facial image doesnot match any of the plurality of registered facial images.
 22. Anapparatus comprising: a memory configured to store one or moreinstructions; and a processor configured to execute the one or moreinstructions to: receive target biometrics information of a person whomoves toward an exit gate in a closed state; compare the targetbiometrics information with a plurality of previously registeredbiometrics information; and output information to open the exit gatebased on a determination corresponding to declaration informationassociated with one of the plurality of registered biometricsinformation matching the target biometrics information, wherein thedeclaration information is a customs declaration.
 23. The apparatus ofclaim 22, wherein the declaration information comprises declaration in acustom procedure corresponding to baggage clearance.
 24. The apparatusof claim 22, wherein the declaration information comprises declarationin a custom procedure at a port.